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ABSTRACT 

California's Master Plan for Special Education 
provides information on the extent and effectiveness of special 
education services for exceptional students in local plan areas 
(LPAs) for 1980-1981. Findings are grouped according to the following 
seven evaluation criteria (sample findings in parentheses): 
availability of special education services (an increase in LPAs from 
21 to 42); correspondence with individualized education programs 
(students were taught in a variety of classroom settings with a 
variety of teaching techniques, although some high school students 
did not receive needed vocational education services); instruction in 
the least restrictive environment (students moved toward regular 
classrooms ; and efforts to provide opportunities in regular school 
programs were generally successful); student changes as a result of 
special education (most made positive changes in seven aspects of 
growth and development); attitudes of parents, students, and school 
staff toward services (regular and special teachers in five LPAs knew 
about and appreciated each other's work, and resource specialists, 
administrators, and program specialists expressed positive 
attitudes); assistance to LPAs in program evaluation (extensive 
participation by school staff, parents, and students in LPA 
evaluations); and use of evaluation to improve programs (special LPAs 
made local decisions on staff allocation, emphases for staff 
development, transportation services, paperwork reduction, compliance 
actions, and program location based in part on information from local 
evaluation studies). Among six appendixes are lists of LPAs 
conducting evaluation studies and methods used by LPAs in evaluation 
studies, (CL) 
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EXECUTIVE SUMMARY 



Tht* C;ili fofnia M;jstor Plan for Spocinl DHucntion i.^ a comprolions i vi* 
.ipproach for providing special education services to individuals with 
exceptional needs in special education local plan areas (LPAs) formed by the 
more than 1,000 school districts and offices of county superintendents of 
schools • 

iXiring 1980-81, more than 200,000 children were receiving, special - 
education services in 21 established and 21 first-year implementer LPAs 
under the Master Plan, as authorized by SB 1870, Chapter 797 and Assembly 
Bill 3075, Chapter 1353, Statutes of 1980. The 42 LPAs included more than 
on**-half of the school districts and offices of county superintendents of 
schools in California. This report is the seventh annual evaluation report 
of Master Tlan programs. 

Tlie Department designed and carried out its 1980-81 evaluation plan to 
build upon the results of previous eva lu^it ions , to yield useful information, 
to reduce paperwork, to minimize duplication of effort, and to prepare for 
statewide implementation of Master Plan services in 97 LPAs in 1981-82. 
Emphasizing the use of evaluation at the local level to improve programs, 
Che Departmt^nt directed a major portion of its evaluation activities at 
increasing the capability of LPAs to evaluate their own programs. 'Ilie 
Department held workshops for staff from established, first-year implemen- 
ter, and planning LPAs. The workshops focused on designing feasible 
local evaluation plans containing evaluation studies which would answer 
local questions. At the same time the studies should contribute useful 
information to help form a statewide picture of the operation and effecti of 
special education programs under the California Master Plan for Special 
Education. Although limited in their genera lizabi li ty , the findings of 
chose local evaluation studies hold interest both as possible indicators 
Cron<ls over a period of time and as generators of ideas for future courses 
of action. The Department collected student information from all local 
special education programs. It should be noted that fiscal information will 
be reported in a separate volume. 

Vor this report, the Department analyzed, interpreted, and summarized 
the child counts reported by the LPAs and results of locally designed 
evaluation studies conducted by eighteen special education LPAs in four 
broad topics of statewide interest: services according to individualized 
education programs, placement in least restrictive environment, student 
pt-r formance , and attitudes toward special education services. The Depart- 
mi*nt also examined its previous evaluation reports. This 1980-81 annual 
evaluation report describes the evaluation efforts, the evaluation results, 
and the use of evaluation in improving Master Plan special education pro- 
grams as California mov3d closer to the goal of full educational 
opportunity for each child who needs special education services. 

The answers to the Department's major evaluation questions are 
summarized as follows: 
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1 • What Wns the Avdi lability of Special Kducation Services to Stud (Mi i « 
Under the California Master Plan for Special Education ? 

a. The number of special education local plan areas (LPAs) was in- 
creased from 21 LPAs in 1979-80 to 42 LPAs in 1080-81. One o^t.-ih- 
lished sinp'le district LPA expanded lo include thi^ ont ire lorritorv 
of the distr.ct under the Master Plan. (Sk}^ pn^^e.s l^i :\i\<\ IS.) 

b. A total of 210,805 students were receiving special education 
services in Master Plan proframs in A2 LPAs on Dect^mber i, 1980, a,s 
compared to 102,275 students in 21 LPAs on Deoeinber I. I07<). (Soe 
pagt> 1 5 and Table 1-1 . ) 

2* Did Students Receive Special Iidu c ntiou Sorvice>< Accord inr , to Tndi- 
vi dua 1 ized Hducat ion Proj^rams ? * ^ 

a. As children's needs were identified, services were provided. 
A continual process of referral, assessment and i ns truct ioiui I 
planning was conducted in cooperation with parents before students- 
received special education services. The 21 estahlishiMl LPAs 
served more than 59,000 newly identified students in ihv twolvi^- 
mnth period between December !, 1979, to l)(H^^ml)or I, MkSO. 
Fvjluation studies from sevente(>n LPAs contained inforrnr'oii about 
services md IKPs. (See oaue 19.) 

b. Students were taught in a variety of clas^>rooin srttinj':. ind with <i 
variety of teaching techniques, accordiu,*? to studies from twiMvi* 
LPAs. However, not all hip.h school aged students nn-'ivrd nnulod 
vocat iona I educa t ion servi ces . ( See p.iye 22. ) 

c. Students* pro^>ress was noted, and their indi vidua 1 i ;:e<l education 
programs (lf':Ps) were revist^d to fit the changi^s in niMvIs , accord in- 
to studies in six LPAs. (See page 22,) 

3. Were Handicapped Students Taught in Their Lea st Res* t r i c 1 1 vo 
Envi ronmen t s ? » 

a. Decisions were made about, the oart i oipat i on oach lundicappcd 
student in regular classrooms. In thv h? I PAs » h^Kh pen cnt o( thv 
210,805 special education stud(Mir-s wert^ enrolled in n^rular 
classes and received special education s»»rvic(^s on a p<irt-tiinc or 
pull-out basis. Of that total, ^A.^ p^-rcent of tho studtMits wtM'o 
enrolled in regular classes and receiviMl dc»s i ona t od instruction and 
services (DIS) such as speech and language instruction. The 
other 55.1 percent of rhe students were enrolled in rej'.ular 
classes and received resource specialist progrcim services on 

n part.- time basis. (See pagi^ IS and Table f-L) 

b. Students moved toward rt'gulir tlass-e^.* (>vrt a t w»' I vt'-'.'.>Pt it |v'Mi>d 
In the i gh teen es tab 1 i shed L^^As whose ^'cograpii i ca I boun la t i i»s 
rema inod the same , ahou t I 7 pt^rcenl of the students no lon*'r t 
ntuviod spec i a I educa 1 1 on sc^rvi ce » and we i ^'t tn ui d to r f^Mi I a r 
<v!ucation proi-rans lull f . In [ '\ ii >.,u • rMrw>J, <i;i jd<iitional 
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4 percent of the students moved to less restricted educational 

settinf>s. Movement toward a less restrictive settin<> occurred in 

n similar proportion from nil four special oducntion instructional 

sottinj^s. (Sec pa<>e 16.) 

c. Evaluation studies from twelve LPAs contained a variety of informa- 
tion about least restrictive environment. Handicapped students 
benefited from their participation in regular classes. According 
to parents and school staff in three LPAs, students were more 
corfPLdent and had more friends than in the past, brought assign- 
ments home, or looked for pbs for the first time. (See page 

U.) 

d. Nonhandicapped students in two LPAs indicated knowledge of the 
purpose of special education programs. (See page 24,) 

e. Efforts to provide opportunities in regular school programs for 
handicapped students in special classes and special centers were 
generally successful, according to three LPAs' studies. However, 
some students experienced difficulty in keeping up with the work- 
load in the regular class. (See page 24.) 

f. The needs of regular classroom teachers for ceaching their hancii- 
capped students received widespread attention. A study of staff 
development sponsored by the Department found statewide efforts 
and needs for both special education and regular education staff, 
particularly for coordinating existing resources and for follow-up 
assistance in schools and classrooms* In-service training was 
provided for regular class teachers as well as for special educa- 
tion staff and for administrators, as described in studies by eight 
LPAs. However, not all regular teachers had ready access to the 
individiialized education programs of their special education 
students. (See page 25.) 

Hid Students Change as a Result of Receiving Special Education 
Serv i ces ? 

.1. The results of evc^luation studies conducted by ten LPAs indicated 
that most of the students in the studies made positive changes in 
seven aspects of growth and development, including personal develop- 
ment, participation in regular class, school conduct and participa- 
tion in school activities, peer group relations, study habits and 
skills, academic achievement, and work habits and skills. Parents, 
as well as school staff, noticed positive changes in their children 
according to evaluaclon studies conducted by nine LPAs. As expected, 
not all students attained all the objectives in their individualized 
education programs, particularly at the hii^h school level. (See page 
28.) 

b. information about student progress came from reviews of student 

records, including TKPs; surveys and interviews of parents^ school 
staff, and students; analyses of scores on standardized tests and 
of ratings of attainment of objectives; and studies of promotion to 
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h'nhor prcKie levels and of students meeting ^rdduntion Udiuiard 
roqu I remt?nts. (See pdcn? ?8.) 

Were the Attiu-des of Parents, Students^ and Schoo . Stnff F.-ivoi-abl o 
Toward the Special F.ducation Services Provided ? 

a. Evaluation studies in eleven LPAs found gem^rally favorable atti- 
tudes and widespread satisfaction. Parents were know le<Ioral) le 
about special education programs and services and oxpri-^s(Ml ^(Mieral 
satisfaction, particularly about their child's progn^ss, accordint^ 
to surveys and interviews in evaluation studies conducted hv n'ww^ 
LPAs. Some parents wanted to know more about certain fe-inres 
such as community advisory committees and dcsi^natod st-rvir(^s and 
instruction. Urban parents were deeply interested in their 
chUdren^s education, according; to an evaluation study bv a 
metropolitan LPA. (See page 32 and Chart V--1.) 

b. Regular and special teachers in five LPAs knew about and approri- 
ated oach other's work. Regular teachers disliked th(^ time and 
paperwork involved in individualized education program planuinj> and 
meetings, but they were pleased at the results for children. (See 
page 3^u) 

c. Program specialists who participated in school site visits, class- 
room observations, and student record reviews in fiv*- Li^\s found 
much to commend. (See paL>e 34.) 

d. In studies by seven LPAs, resource specialists desrri!)e<l voui-rallv 
smooth operations in many elementary sch(H)ls and then' won- wori^inj> 
on improvements needed, such as career-vocational education 
opportunil i(»s for secoi;darv school stfidenl^. (S<n' p.j'M- . ) 

e. In studies hy seven-LPAs, administrators pointed out specif i 
examples of good teaching and expressed i>eneral satisfaction with 
special education programs. (See pa^^e 35.) 

f. In studios hv fou- LPAs, students reported positive attitudes 
towards special education, such as decreases in labelling',. Ki'gulai 
students referred themselves for special education services* 
Special students commenteu on their satisfaction at seeiiu* their 
own improvement. (See page 35.) 

Were Special Kducation Local Plan Areas Assisted in Pr(M^<i^ini' to 
Evaluate Their Own Special Lducation Programs / 



rightecii estahlishtul spt»cial education I.PAs il(-nguo<l ind r-nidu. t (vi 
one or iMori* ev<ilnation 'Wudjos on taci^ts ol Ihi-ir own spocial 
odUiil ion Dfoy'raiMs Keordnu* to thou own t .i i 1 or -rnadi' loial .nMlu- 
at ion Dlans. The l)er)artmon: a'.<;is!ed the I.PAs in ili^sijuiinv. their 
• »vJlua(inn •;ludiev:. Thr fsndiui's ( i ,>ai t lir .e 1o<j1 ':lndit»s have 
bo, Ml i n< orpoi at ♦'d in t In rtM>^>rt. ^^'..-r p » 1! ,Mid Ar>prndicos A 
and [). ) 



I). Ihoro w'ls cxtonsivi* p*irt ic i pac i on by school staff, parents, ,inci 
students in the LPAVs ev;iluation studios in a variety of w ys: 
(losi ;>nin<s collect inj> information, interpreting; results, .\<\ 
preparing to »is? th*^ results i ii ^ improv i n;; local speci-j U4?.duc at i on 
pro>i:r.ims. (See pai^e ^*6.) " 

c* As part of its technical assistance m Local sru'cial education 

progran:^ evaluation, t\u* D»M>^'i rtinont of Fiducatton held or sponsored 
20 workshops for ?67 local staff. Tlie workshops were conducted in 
cooperation with the eight f:valu;irion improvement Proe.ran Rec'ional 
Centers- (See pa<>e 41, Table VI-?, and AppiMuiix B.) 

J. All ^/ LPAs were preparing to conduct their own evaluation studies 
durini* 1981-82. (See Appendix F.) 

V/as Kvaluation Used to Improve Special Education Programs ? 

a. Statewide trends were noted in proj^ram operations related to 
Calilornia's p,oa I of full educational opportunity for each child 
who needs special educational services. Positive trends suj»- 
^^ested that no major chan^u^s in emphasis were needed in areas 
^ucii as cUie process prot (»c l i ons and <i(» ve I opnuMU of ind i v i dua I i j^eci 
rviucalion proi»rams. (StM* [);ji'.»s ?1 and M.) Continuing n<^e<ls. 
such .is t(»clinical assistance in local proi'ram evaluation, l(»d to a 
statewide technical assistance elfort. (See pai;e 37.) Unsatisfac 
tory trends, such as continued perception of paperwork burdens, le 
to proposals for changes in local forms and for publicity on the 
loc^il and state uses of teacher-provided information. (See papes 
10 nnd A6.) 

b. Spc^cial education I.PAs mado local decisions on staff allocation, 
empliast^s for staff d(»vc lopment , transportation services, paperwork 
reduction, compliance actions, and prox",ram location, based in part 
on the information svnned in local evaluation st»idi<»s. Proj'raip 
chanj^.es over a period of vears wort^ (»xamin(»d by si*veral I.PAs, (St» 
pa>»<^ ^\h.) 

c. At tlie school hwel, tho evaluaii.;n studi»» ol f(M*ed oppoi t un 1 1 i ^s 
for school site and itinerant staff, alon;*, with parents, students, 
'ind coripunuty advisory committec^s* to ask pro(»ram questions anil to 
uso their own answers to improve prov^rams. Rxamples art* 
iiiprovoment s in comtnunicat i n<; about students at the critical 
points of c'nanj^os between elementary and secondary hi^^h sciiool 
sites. (See p.igo A 7.) 

d. In preparing for full implementation of .'(aster Plan services 
throuijhout C-ilifornia durin>» l^)81~d2, tho Department .ind the 07 
LPAs worked tOjC-ether to Jesi^^n l<Hal evaluation studies and a 
comprehensive statewide' evalihition plan. ( Soc pa^es 4 1 and A8 and 
Apnondi X P. ) 



INTRODUCTION TO THE 1980-81 EVALUATION REPORT 
ON THC CALIFORNIA MASTER PLAN FOR SPECIAL EDUCATION 



The purpose of this seventh annual report is to describe the evaUu-j- 
t ion efforts, the evaluation results, and the use of evaluation in improvin^^ 
special education programs under the California Master Plan for Speci.il 
Education. The report contains findings on the availability of special 
education services to students, services according to individual education 
programs, least restrictive environment, student performance, and atlitu<los 
.toward special education services; and describes the actions taken by the 
Department and by local staff to evaluate special education pro^Jtranis and lo 
use evaluation in improving local programs. Fiscal information is contnineJ 
in a separate volume. 

Leg^islative Authorization for the DepartnuMit 's Report 

This report , is authorized under Education Code Section 56602, which 
calls for the Superintendent of i^;blic Instruction to submit annua I ly--to 
the State Board of Education, the Lej?is lature , and the Governor — an annual 
evaluation report of special education programs conducted under the Califor- 
nia Master Plan for Special Education. (See Appendix C for the wording of 
the Education Code provisions.) 

Pursuant to Education Code Section 56607. the Department has con- 
tracted with SRI International (SRI) to conduct an independent evaluation 
ol Master Plan pro^'^rams throuj^h January 1982. The contractor is rt*spi)n*^ ih N- 
for preparing reports emphasizint; the summative outcome aspects o{ spiuijl 
education proj»ranis. 

Special Education Programs Under the California Master Plan 

The California Master Plan for Special Education is a comprehms i vt' 
approach to provide special education services in the more than a thiiusand 
school districts and offices of county superintendents of schools thriuighout 
the state. These services are designed to provide appropriate educational 
opportunities for all individuals with exceptional needs. Continual local 
evaluation is required to ensure the highest quality educational offerings. 

Traditionally, special education programs were authori2e<! on a cate- 
gorical basis related to a specific handicapping condition. As parents o\ 
children with various specific handicaps voiced their needs over <j period of 
more than 100 years, new programs were added until ?H different catin'orir.il 
pri)jL;rams were funded. Although this approach provide^! nect^s'^arv servi(,t»s li) 
many handicapped individuals, many other children with exceptional net'<ls 
wert* eithi^r not reci»iving services or we* re receiving limittnl siMvi(os often 
i n-ippropr ia te to their educational needs. There was little or no sv eternal i« 
evaluation of local programs and no statewide evaluation. 

The development of the California Master Plan for Special Education 
bega«^ in 19 70 with extensive studies and reviews of existing special 
education services and included a series of statewide public inptit seminars. 

6 i,) 



ERIC 



This infonnntion provided n basis for the development of n plan for special 
education developed by the Department of Education and the Advisory Commis- 
sion on Special Kducation, which the State Board of Education formally 
adopted as the California Master Plan for Special Rducanion in January 1974. 
The California Master Plan preceded and is consistent \^ith Public Law 
94-142, the Education for All Handicapped Children Act of 1975, which 
requires states to provide an appropriate publicly supported education to 
hanciicapped children. 

Tlie major features of the California Master Plan and its authorizing 
lo}»islation include the following: 

1 , Special education local plan areas (LPAs ) 

^ 0 District and county boards of education, with advice from a commu- 
nity committee, choose the form of organization best suited to 
their local situations and the needs of their handicapped children. 
An LPA may be composed of a single large school district, two or 
more districts, ^r two or more school districts and an office of a 
county superintendent of schools. Whatever the pattern of organi- 
zation, the LPA must he large enough to provide the full range of 
services required by individuals with exceptional needs. This 
combination of resources allows for the provision of services that 
a single small or medium-sized school district or office of a 
county superintendent of schools might not be able to provide. 

o A local plan is developed by each applicant LPA for the geographi- 
cal area served by the local educational agency or agencies 
participating in the LPA. I'he local plan is commented on by the 
community advisory committee and approved by the local school board 
or boards before being submitted to the Department and to the State 
Board of Education. The local plan tailors the requirements of the 
Master Plan to the needs of the children and the local area. Each 
local plan must include an indication of how the applicant will 
(1) provide tor the seekiny> out of all local individuals with 
exceptional needs; (2) make services available to meet the needs of 
all individuals identified as havin^» exceptional needs; (3) provide 
for parental involvement and procedural safeguards; (4) use avail- 
able rc^sources at the local level to meet the needs of individuals 
with exceptional needs; (5) conduct staff devOopment activities 
for regular and special education staff; and (b) mvnnage local 
programs . 

o When the applicant's local plan is accepted by the State Pepart- 
ment of Fducat ion and approved bv the Stalt* Board of Kducation, 
the geographic area covered by the plan is then known as a special 
education local plan area (LPA). 

o Each special education LPA develops an annual local evaluation 
plan tailored to its local needs which will also meet state and 
federal requirements. The plan is reviewed and approved by the 
Hepartment of Education. 
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o Eacb LPA has <i conimuniCy advisory committee. Parents comprise* 
the majority of the committee. Among other t^ ics, the committoe 
<idvises the bPA in the development and review of proprnms under 
the local comprehensive plan, assists in parent education, and 
encourages public involvement in the plan. 

o In implementing its local plan, each LPA uses the . servi ct^s of 
program specialists. i\mong the responsibilities assigned to 
persons in this staff position in the Master Plan are ensuring 
adequate curricular resources to all staff members who work with 
special class students and assessing the ef f'ect iveness of sp(*cial 
education programs. 

o In evaluating the special education programs, each LPA designs and 
conducts at least one special evaluation study each year to answer 
local evaluation questions and improve its own programs. 

2. Instruction and educational services 

o Special education means instruction and oihicational services spe- 
cially designed to meet the unique needs of individuals with 
exceptional needs and provided at no cost to the parent or child. 
Such instruction and services mnv include (but are not nc^cessarilv 
limited to) classroom instruction, language and speech instruction, 
psychological services, educ<'i t i onal ly related iherapies, special 
physical education and vocational education programs, parent 
education, health nursing services, and school social work. 

o Each LPA's local plan includes four instructional compcnients: 

(I) special classes and centers; (2) tlio resource specialist 
program; (3) designated instruction and services; and now 
public school services. 

o Special classes and centers are designed for childr* i with moder- 
ate or severe handicaps who are able t*^ spend littl*^ or no time in 
regu lar c lass rooms . 

o llirough the resource specialist program, instructional planning, 
special instruction, tutorial assistance, and other services are 
provided to individuals with exceptional needs in re>',ular class- 
rooms or special programs or both. Assistance to teachers in 
regular classrooms ma> also be provided. 

o Designated instruction and services are specific anti are not 
normally provided in regular and special class programs or in 
resource specialist programs. One example is speed) and lanj>ua)H' 
theiMpy for children who havo d i f t i cu 1 1 i (vs in t:alking. AnothtM 
exanple is orientation an<l m(»bililv trainin)» lot childn^n who 
tannot see well enotigh to ^'el artum^l by llumselves. 

o Nonpublic school services arc oftered lo i nd i *'i diia I s with i\. . 

tional needs when the staff and the oarent deiernine thai services 

appropr i a t e to t h«^ needs o( ind i vi dua I ch i I d a re not .iv<n I ab I e 

in the public school. 
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0 State residential school services are also available to meet 
highly specialized educational needs of individual students, 

3. Provision of services 

o Special education services are offered in the regular class or in 
a special education setting, in cooperation with the student's 
parents , and according to each student 's individually de termi ned 
need as reflected in an individualized education program (lEP), 

o The processes of identification, assessment, and instructional 
planning for individuals with except iona I needs are conducted by 
individualized education program planning teams (lEP teams) in 
each LPA. An lEP team reviews all referrals within a particular 
school and makes recommendations regarding such referrals in 
accordance with state and federal laws and regulations. Special- 
ized educational assessment personnel review referrals for in- 
depth studies of individual student s ; the referrals come from 
lEP teams, from parents, and from other sources. On request, 
specialized assessment personnel conduct assessments of students 
and make recommendations to an lEP team, as appropriate. An lEP 
team is responsible for reviewing each student's progress at least 
annually and for revising the lEP. Parents are encouraged to 
participate in each step. 

o A written individualized education program (lEP) is developed for 
each special education student. An lEP describes the student's 
need, the type and amount of special education services to help 
the student, the objectives the student is to achieve, partici- 
pation in regular programs, and methods of assessing progress. 

o 'ITie intent of helpful attention to the needs of each child is 
carried out by supplying information to parents, by conducting 
careful assessments, and by making individual decisions for each 
child. 

A . Individuals with exceptional needs 

Individuals with exceptional needs are those students whose educational 
needs cannot be met within the regular classroom^ <»von with modifica- 
tion of the regular program; and who have been dt^cennined by both 
parents and professionals to require the additional benefit of special 
education because of demonstrated physical, intellectual, or serious 
emotional handicap or as a result of a specified behavior, learning, or 
language disorder . 

*) . State financial assistance 

State financial assistance to special education programs has changed 
several times under the Master Plan authorizing legislation, first 
under Assembly Bill 4040, then under Assembly Fiill 1250, and later 
under Senate Bill 1870. The proportion of the state funding was 
increased, provisions were made for future annual inflation adjustment, 
and in SB 1870, the fiscal model was changed. 
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6» Comprehensive program evaluation 



Evaluation responsibilities are placed on tha Department and on LPAs, 
The intent of local evaluation is to improve local programs. The 
intent of state evaluation is to provide information for refining 
programs and for judging the merits of statewide programs, while 
simultaneously providing technical assistance to LPAs, coordi nal i 
the desi^^n of local and statewide evaluations, minimizinf^, duplication 
of effort, reducing the paperwork burden on local schools, Jnul 
preparing statewide evaluation plans and reports. ^ 

Impact of Previous Years' Evaluation Reports 

In previous reports the Department noted several topics of statowide 
concern. The actions taken in 1980-81 by the Department and the special 
education local plan areas (LPAs) to address those concerns are sumnarizod 
as follows: 

The Needs of Regular Classroom Teachers 

The emphasis in staff development shifted from general awareness of 
handicapped students and the law to knowledge and skills for teach i no 
individual handicapped students. The Department conducted a staiowido 
study of staff development, and found a great need for coordi nat in;» 
existing resources and for conducting follow-up assistance in schools 
and classrooms. Local studies showed both areas of accomj)l ishmenl and 
continuing concerns, particularly at the high school level. 

Paperwork Burdens 

The Department continued to emphasize local evaluation stu<iL{»<^ and to 
minimize statewide Department evaluation studies. The Dep.*^ mont used 
existing information whenever possible, rather than colle.»in<', addi- 
tional data. The authors of a study of local paperwork iound that 
about one-third of the burden was due to local requirements over and 
beyond state (and federal) requirements, and recommended thai hPAs 
examine and streamline thoir paperwork. However, changes in state <ind 
federal data collection and reporting requirements continued to cause 
difficulties for local agencies <ui<I led lo sone local overcol 1 eel i on oi 
da t a . 



Measurement of Student Progress 

Special education LPAs continued to review oach child's progrc^ss <it 
least annually. An increas(»d number of loeal (^valuation studi(»s wert* 
conduct.(»d on the porformanre of groups of stu(hMUs. While in )»imummI 
the progress ol individual students was sa t Isfaelory to parents, tin 
progress of groups of stiudents, particularly at the high school levi ', 
remained a concern. 
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Regionallzatlon 



The number of special education local plan areas (LPAs) increased from 
21 to 42 in 1980-81. All districts and offices of county superinten- 
dents of schools in California were scheduled to be in 97 operational 
LPAs during 1981-82 and were intensively working for a smooth start. 
Governance and fiscal Issues continued as concerns. 



Noeds of Special Education Students in Secondary Schools 

Several LPAs emphasized secondary students and staff in their local 
evaluation studies, and made program changes as a result, such as 
inc reas ing the commun icat ion between elementary , jun ior h igh , and 
senior high schools. Concerns remained for Increasing the av.! ilahi 1 ity 
of vocational and career preparation opportunities and for focusing 
on high school graduation requirements. 



Lack of Clear Eligibility Criteria 

In accordance with an interagency agreement, the State Department of 
Education assisted the California Youth Authority in developing eligi- 
bility criteria for learning handicapped programs and for identifying 
students with severe emotional disturbances. Recent legislation 
(Senate Bill 759, Chapter 1094, Statutes of 1981) requires the adoption 
of regulations governing eligibility for special education in special 
education local plan areas. This legislation requires that the State 
Board of Education consider any eligibility options which may be 
indicated by SRI International in its independent evaluation of the 
Master Plan. 



Statewide Need for Local Program Evaluation capability 

Kighteen of the 21 established special education LPAs conducted 
their own evaluation studies to answer their own local questions, 
accord ing to the ir own local eva lua t ion plans . In preparat ion for 
statewide implementation of the California Master Plan for Special 
Education in 97 LPAs during 1981-82, the Department conducted a state- 
wide series of workshops on local special education evaluation, in 
cooperation with the eight Evaluation Improvement Program Regional 
Centers. A total of 145 local evaluation studies were planned by the 
97 LPAs for 1981-82, with continuing technical assistance and coordin- 
ation provided by the Department. (See Appendix F for the list of 
local evaluation study topics.) 



Department of Education Evaluation Plan for 1980-81 

The Department's plan for 1980-81 was a cooperative effort with the 
special education local plan areas. One purpose of the Department's evalu- 
ation effort was to prepare for statewide implementation of the California 
Master Plan for Special Education in 1981-82. Tlie second purpose was to 
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provide the Legislature, the State Board of Education, the Governor, and 
state and local educat ional program adininistraLors with the infornuition 
needed to refine and improve policies, regulations, guidelines, and 
procedures on a continuing basis. 

The Department's program evaluation plan emphasized the use of evalu- 
ation to improve local programs, was built on the results of previous 
evaluations, and was aimed at preventing duplication of e/forts and minimiz- 
ing data collection and reporting burdens at the school and district levels. 
In designing their local evaluation studies, local planning areas were 
encouraged to use existing information, such as student and program records, 
and to select samples of parents, teachers, and students, instead of 
conducting additional large-scale datri collection activities. 

The plan vas designed to use the results of evaluation studies con- 
ducted by the established special education LPAs on topics of statewide 
interest: services according to individualized education programs, place- 
ment in least restrictive environment, student performance, and aLL itucK' 
toward special education services. The results ol' studies from oighteen 
LPAs were analyzed and interpreted for this report. Although limited 
in their general i zabi li ty , these findings are interestin.?> as possible 
indicators of statewide trends, particularly over a two- or throo-ytNir 
period; to demonstrate local uses of local evaluation; and to provide ido.is 
for future courses of action, (See Appendix A for a list of the IPAs whost* 
evaluation studies were received in time to be analyzed for this report 
and Appendix D for the methods used by the LPAs in 1980-81,) 

In preparing this evaluation report, the Departmeiit used a number 
of existing information sources and points of view# Information sources 
included child counts and evaluation studies from the LPAs; descriptions of 
special evaluation studies conducted by the Department; descriptions of 
technical assistance in local program evaluation provided by the iJi'p,ir tuiiMit ; 
and previous Department evaluation reports. The information sou'crs W(^r<.' 
analyzed, interpreted, and summarized for this report. 

Seven major evaluation questions were the primary focus of the Depart- 
ment's evaluation efforts during, 1980-81. Each question is discjssed in a 
separate chapter in the report: 

!• Wliat vas the availability of special education services to iitudents 
und(^r the California Master Flan for Special Education? 

II* Did students receive special education services accordin^i to li\eir 
individualized education programs? 

III. Were handicapped students t?>u5>ht in their least restrictive 
. env i ronnuMU: V 

IV. Did students change as a result of receiving special education 
se rv i r(* s ? 

V. Were the attitudes of parents, students, an<l school «ital( lavoiahle 
toward the special education services provi(hMl? 
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VI. Were special education local plan areas assisted in preparing to 
evaluate their own special education programs? 

VII. Was evaluation used to improve special education programs? 
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CHAPTER I— WHAT WAS THE AVAILABILITY OF SPECIAL EDUCATION 
SERVICES TO STUDENTS UNDER THE CALIFORNIA MASTER PLAN 
FOR SPECIAL EDUCATION? 



The Department's first evaluation question for 1980-81 was, '*Whnt was 
the availability of special education services to students under the 
California Master Plan for Special Education?" 

o A total of 210,805 students were receiving special education ser- 
vices in 42 special education local plan areas (LPAs) on December I, 
1980, the annual counting day. 

o The 42 special educat ion LPAs included more than half of the 

school districts and offices of county superintendent of schools 
offices in California. 

Chapter I contains background information on the implementation of the 
Master Plan and a report on the progress that was made in 1980-81 toward the 
goal of providing full educational opportunity. 

Implementation of th e Master -iplan 

^ 

As shown in Chart I-l, the implementation of the California Master Plan 
for Special Education began in 1975-76, with six first-year implementer 
special education local plan areas (LPAs). 



CHART I-l 

Annual Progress of Implementation of the California 
Master Plan for Special Education, 1975-76 to 1981-82 



Number and status of Special 
Education Local Plan Areas (SKLPAs) 



Year 


Firs c-year 
implementers 


Es tab 1 i shed 
SELPAs 


To t a 1 


1975-76 


6 




6 


1976-77 




6 


10 


1977-78 




10 


10 


1978-79 


7 


10 


1 7 


19 7<)-K() 




17 


?l 


1980-81 


21 


21 


42 


1981-82 (projected) 


42 


55 


97 

(s tatowido ) 



14 

18 



Pursiinnt to Senate Bill 1870, Chapter 797, Statutes of 1980, Master 
Plan services are scheduled '".o be available statewide by the end of the 
1981-82 schol year to children in all California school districts. 

The original legislation (Assembly Bill A040, Chapter 1532, Statutes of 
1974) allowed only a few special education LPAs to enter the faster Plan in 
l\w first year, 1975-76. Several school districts, counties, or combina- 
Lions of those submitted locil plans; i.e., applications. Of those volun- 
teers six were selected by the State Department of Education and approved by 
the State Board of Education to pilot the concepts contained in the Master 
Plan beginning in 1975-76. This selection was based on such criteria as 
size and scope of the programs proposed in the local plan; compliance with 
legal requirements; state distribution factors (e.g., north, south, central; 
urban, rural; minority populations represented; and so on); and availability 
of funds. During 1975-76 additional plans were submitted to the State 
Department of Education for possible selection in 1976-77. Four plans were 
selected through the use of the criteria previously listed. In '978-79 an 
additional seven areas were added through the same competitive planning and 
appl icat ion process . 

According to AB 1250, Chapter 1247, Statutes of 1977, which authorized 
a phased statewide implementation, in 1978-79 the State Board of Education 
adopted a phase-in plan identifying the specific LPAs to enter the Master 
Plan beginning in 1979-80, 1980-81, and 1981-82. This movement from a 
competitive planning process allowed local schools to set a date for imple- 
mentation of quality programs under the Master Plan and to spend less time 
on submitting and resubmitting competitive local plans for state approval. 
During 1979-80, more than 100,000 children were served by 17 established and 
four first-year implementer LPAs. 

Progress Toward the Goal of Full Educational Opportunity in 1980-81 

During 1980-81 more than 200,000 children were receiving special 
education services in 21 established and ^1 first-year implemencer special 
education LPAs under the California Master Plan for Special Education. 
Together, the 42 LPAs included more than one-half of the one thousand plus 
school districts and offices of county superintendents of schools in Cali- 
fornia. Geographical areas were changed in three established LPAs. In two 
of thvise LPA5, the configuration of constituent districts was changed. In 
the third LPA, the entire large metropolitan district came under the Master 
Plan according to its phase-in plan. In the remaining areas of the state, 
55 "pl'^i^^ing" ^-PAs scheduled for establishment in 1^)81-82 were serving 
<approximately 150,000 children as they prepared to offei Master Plan 
services and to evaluate their special education programs. 

Student enrollment . On December 1, 1980, the annual ''counting day," 
the 42 LPAs reported serving a total of 210,805 students in special edu- 
cation programs, as compared to 102,275 reported by 21 LPAs on December 1, 
1^79. As shown in Table I-l, more than two-thirds of the students were 
enrolled in regular classes and received designated instruction and services 
(35. i percent) or resource specialist program services (34.5 percent). 
About one-fourth of the students were enrolled in special day classes (28.9 
percent). A small number of students were enrolled in nonpublic schools 
( 1 .4 percent ). 
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TABLE I- I 



Students Served In Four Special Education Prop,rains 
on December 1, 1980, in 42 Special Education Local Plnn Are.'KS 



Special education program and instructional settin;? 


Student 
Total 


3 served 
Percent 


Designated instruction and services and regular class 


7A,078 


35.1 


Resource specialist program and regular class 


72,790 


34.^ 


Special class or center 


61,002 


28.9 


Nonpublic schooling under Master Plan 


2,935 


I .4 


Total on December 1, 1980 


210,805 





Source: "Special Education Pupil Coun" and Staff Dara, December I, 1980." 

Sacramento: Calif ornia State Depar t me n t of Educ ation. Office of 
Special Education, 1981. 



Ethnicity . On December 1, 1980, the 42 LPAs reported servin)> slu- 
dents in six ethnic groups, as shown in Table 1-2. Proportional to tho 
ethnic distribution of the kindergarten through twelfth grade (K-12) 
enrollment ip these 42 LPAs , more white and black students wert' roceivini^ 
special education services than was true for any of the other ethnic 
groups. Table 1-2 also shows the ethnic distribution of K-12 enrollment in 
the 42 LPAs and in all California public schools. 

Movement of students among instructional settings . Ove r a <^ne -yea r 
period, the 18 established LPAs whose geographical boundaries rMnained the 
same reported that a total of 14,328 ( 1 7 percent) students n^^^ d out of 
special education programs to regular classes; 22,624 (28 (> icent) students 
moved from one special education program to another. Tabb 1-3 «1ispl;iys tho 
information from a one-year follow up of 82,189 students wfio were rccrivin^* 
special education services on December 1, 1079. For example, 27,860 stu- 
dents were enrolled in regular classes and were receivin^^ desipnared 
instruction and services (DIS). \/liere were the students one year Inter? 
Seven thousand, seven hundred and eleven (27.7 percent) had moved to regular 
classes without special education services. Fourteen thousand, two hundred 
and s ixty-e igh t (51.2 percent) rema ined in the same placement : euro 1 led in a 
regular class and receiving DIS. One thousand, six hundred twenty- two (5.8 
percent) had moved to regular classes and were receiving rosouico spi'cialist 
program services. One thousand, sixty- three (3.8 pt^rcenl) had miovimI to a 
special class or center. 



TABIR T-2 



St lultMU Kthnicity in A2 Special Education l.ocal Plan Areas, 
by Enrollment in Special Education i^rograms and in 
Kindergarten and Grades One through Twelve 





Student enrollment in 


Percent of total 
K-1? student 
enro I Iment*^^ 




special education programs* 


42 


O L <1 L 


Ethnic icy 


Numb e r 


Percent 


LPAs 


wide 


/\inoricnn Indi an/ 
Alaskan net ive 


1.492 


0. 71 


0.91 


0.91 


Black , not of 
Hispanic origin 


23. 889 


11.33 


9.42 


10.41 


Asi an 


4.626 


2. 19 


3.92 


4.3i 


Fi I i^ino 


1.421 


0,67 


1.30 


1.4A 


llisj>an ic 


49,577 


23.52 


26.31 


23.39 


White, not of 
Hispanic origin 


129, 800 


61.57 


58. 15 


59.94 


Total 


210.805 






4 



Sources: **'Special Education Pupil Count and Staff Data, D.<^cember 1, 1930." 

Sacramento: California State Department of Education, Office of 
Special Education, 1981. <i 



^^ Racial and Ethnic Distribution of Students and Staff in California 
Pub I ic Schools , Pal 1 , 1979 . Sacramento: California State Depart- 
ment of Education, Office of Intergroup Relations, 1980. 



Progress Expected in 1981-82 

During- 1981-82, Master Plan services will be availnhlo to all children 
throughout California, as all school districts and offices of county super- 
uitt'ndentfi of schools will be included in special education local plan 
jreas. It is anticipated that approximately 375,000 students will be » 
rtn.Mviuj^ special education services in 97 special education local plan 
jr»v'm on December 1, 1981, the annual counting day. 




TABLE 1-3 



Movement of Special Education Students from Four Instructional Settings 
Over a One-Year Period in 18 Special Education Local Plan Areas 



Student Placement as of December 1, 1980 



Number of sCiidents in four 
instructional settings and 
special education programs as 
of December 1, 1^79 


Moved to 
regular 

class 
without 
specia I 
educat ion 
programs 


Moved to special education settings 


Other* 


Des ignated 
instruc- 
tion and 
services 


Resource 
specialist 
program 


Spec i a 1 
class or 
center 


Nonpublic 
schooling 


Regular class and designated 
instruction and services 
27,860 students 


7,711 

27. 7% 


AA 

(14,268) 

(5i.2r;) 


1,622 
5.8^ 


1,063 
3.8% 


15 

0.05% 


3, 181 

1 1.4% 


R^*iMilar class and resource 
spt-cial ist program 
studtMits 


5,055 

15.6"^ 


1,223 
3.8"/ 


A* 

( 1Q,1 11) 

(59. ro 


2,017 

6.24% 


6 

0.02% 


4,922 

15.2% 


Special class or center 
21 , 580 students 


1,546 

7.2-? 


577 
2. T' 


1,672 

7.7°/ 


A* 

( 14,615) 
(67.7%) 


27 

0. 13% 


3, 143 

14.6% 


Nonpub 1 Lc schooling 
'♦15 s t u ti e n t :5 


16 


14 
3.4'' 


13 

3. r 


4 7 

11.3° 


A* 

(265) 

(63.9%) 


60 

14.5% 


rv>tal \H') ^Mid. nts 

>^rcent of total 


14, )28 

17.47, 


16,ti«2 

19. 6-/ 


2 2,4 18 
27.3'- 


17,742 

21.6T-; 


313 

0.38% 


1 1 , 306 

13.8% 



"Special Education Pupil Count and Staff Data," Docombor 1, 1^80. Sacramento: California State 
Depaitnent of Education, Office of Special Education, 1981. 



^"Other" was defined as "Gradu.^'^, dropout, death, transfer out pi LPA, and incomplete information.'* 
^*The information in these four bi indicates the number and percentage of students who remained m the 
saiT>e instructional settinr one ye.i Inter. 
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CHAPTER II— DID STUDENTS RECEIVE SPECIAL EDUCATION 
SERVICES ACCORDING TO INDIVIDUALIZED EDUCATION PROGRAMS? 



Ono of the Department's m<ijor evaluntion questions for 1980-81 wds, 
"Did students receive special education services according to individualized 
education programs (lEPs)?" 

< o Through the process '>f assessment and development of lE^s , care 
was taken to determine each child's need for special education 
services. An lEP was designed by an lEP team for each child before 
special education services were provided. The rights of parent, and 
children were protected. 

o Both special an 1 regular teachers were teaching according to 
their students' individualized education programs (lEPs). 

o Student progress was carefully noted and discussed. Students' 
lEPs were revised to reflect changes in needs. 

Chapter Ii contains background information on the evaluation of 
lEPs , the results of the Department's analysis and interpretation of local 
evaluation studies conducted by 17 of the established special education 
Local plan areas (LPAs) in 1980-81, and statewide conclusions and trends 
over the period 1976-77 through 1980-81. 



Evaluation of Individualized 
Education Programs (lEPs) 

One of the major features of the California Master Plan for Special 
Education is the emphasis on the needs and abilities of each student and 
the provision of special education services on, the basis of need, not 
handicapping condition, as stated in each s^udent 's lEP. Special education 
services include classroom instruction, language and 5?peech instruction, 
psychological services, educationally related therapies and recreation 
services, special physical education, and vocational education progr airs . 

Tlie individualized education program (lEP) is a document developed 
by an lEP team composed of school staff and the parents ot the student, and 
when appropriate, the student himself or herself. The lEP describes the 
student's need, the type and amount of special education services to help 
the student, the extent of participation in regular education programs, the 
objectives the student is expected to achieve, and methods of assessing 
progress. During the one-year period from December 1, 1979, to December 1, 
1080, lEPs were developed for over 59,000 students newly served in special 
education programs in the 21 established special education LPAs. 

From the beginning of the California Master Plan for Special Education, 
the Department ha^ worked cooperatively with the established LPAs to examine 
the concept of lEPs in practice. As more LPAs began to design and conduct 
their own evaluation studies, the Department shifted its emphasis from 
conducting statewi-Je studies to assisting LPAs in designing their own 
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studios and to dnalyzing the results of those studies for incorpoi ion in 
the Department's annual evaluation report. 



Findinp^s on Services According to IKPs in 1980- H 1 

The local evaluation studies from the LPAs provided inf ormn t ion about 
the three phdses of service: (I) before placiMiient in special (Hluo<Hion 
programs, or identification, assessment, and instructional planninj'; 
(2) providing; instructional services — teaching; and (3) roviowol" sludont 
progress after receiving instruction — a<>ain. identification, ass(\ssnient . 
and instructional planning. 

The LPAs gathered this information by reviowini^' student r»»cords, 
including lEPs; analyzing program records, such as the mimbrr of rofor- 
rals; surveying and interviewing school staff, parents, and students; 
visiting school sites; observing classrooms and lEP team meetinj^'s; and 
making comparisons with other studies. (See Appendix D for a discussion of 
the methods used by LPAs in 1980'-81.) Findings for each phaso of service 
will be summarized separately. Findings are from indivi^iual LPA^, unlt*ss 
otherwise stated. 

Phase 1. Before Placement in Special' Education Pr o^.rams . S t ud i s t r t >iii 
17 LPAs contained information about identification, assessimvU ,ni<i 
instructional planninj*: 

— Fewer students were referred in !9H()-8l than in th<» prtwious vtMr, 
but a higher percentage was declared el iiMhle--2,03() now students 
enrol led . 

— Some of the regular teachers were confused about tht* nMcrral 
process, but, on .the whole, the process was workiM-,. 

— Students in two LPAs were referred for possible stu* ')v thrir 
parents or guardians, <5taff in the public schools, public 

and private agencies. Referrals were also m.» h» by .he schools to 
other community agencies. 

— Both LPA and outside assessnent personnel usihI s t andard i x.iMi losls 
in the areas of reading, arithmetic, and lanj^ua^^e- ^^of^l frequiMitlv 
used were the W i d e Ra n .?>.e Ac hi e vene n t Te s L , the l^eahcMly Indi vidua I 
Ach ieveine^nt^Test , the Keymath Ari thmet ic T(*st , and thv Woodroc^k 
Reading ^^^'^^'^^^'^y * 

— In 16 of the H schools visited bv an LPA toam, t ht» stu<ient s had 
objectives to be carri»»d out at homo. 

P.if'iXs, rosotirci* speiialists, .-md piincipals it\ lwi> I PA*. .irMM^I 
that tho ILP deve lopmi*nt process worked well and on^t inu» lot -mi 
tial child study, assessment, and IMP toam niei^t iny's ; .nid wh i ' 
the key person was tht» n»sourct» spoiialist, par»»nts rontribm 
much helpful information. 
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— Students' lEPs were, on the whole, well done in two LPAs» 



— Enrollment of students in special education programs as a per- 
centage of total district enrollment has stabilized over the past 
two years . 

— IKPs wero documented and boin^, carried out, according to team 
visits to 120 scho9ls in five LPAs. 

— Although there were some sites at which files were poorly orga- 
nized and some information was missing or omitted, another LPA's 
review of findings over three years showed much progress, with 
student records nearly universally in compliance. , 

— Due process procedures were doc^imented according to student 
record reviews in six LPAs. 

— Students took part in about one-fifth of the TliP team meetings* 

Phast^ 2^ Providing Instructional Services — Teaching . Studios from 12 
l-PAs provided information about teaching handicapped students: 

— Teachers were individualizing students' work and assignments and 
had the appropriate supplies and equipment. 

— All the services indicated on a student's lEP were being provided 
for nearly all students in resource specialist programs or special 
classes in five LPAs. 

— Teachers of hearing impaired students reviewed their own progress 
in implementing the instructional objectives in their students* 
IP^Ps, and they reported that the implementation ranged from AO 
percent to 95 percent. 

— Resource specialists were teaching their handicapped students up 
to six hours a week in regular classrooms. 

Instructional aides in resource specialist pro)^r.ims and special 
day classes worked with handicapped students in regular class- 



— During one month alone in one large urban district LPA, 25,508 
handicapped students were being taught by 1,876 special class 
teachers and resource specialist program teachers, while another 
191 handicapped students were enrolled in teleclasses (telephone/ 
television) taught by ten teachers. 

— In three LPAs , about one-third of the handicapped students in 
resource specialist programs and over one-half of those students 
in special classes were al«o receiving services from the desig- 
nated instruction and services staff. 
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~ H^r!" vocational education were mentioned in about one-hnlf of 
the high school students' lEPs. 

- The teacher-to-student ratios in resource specialist proPrms 
ranged from 1:15 to 1:26. 

- A locally-trained team judged the special education pro,.r.im« 
17 schools to be overall of high quality and found only seven 
instances in which corrective actions for compliance wor^^ called 
tor. The actions were taken by appropriate site or LPA staff. 

K.T ^' ^r"^"" °^ After R eceiving Instruction . Studies 

trom SIX LPAs contained information about the reviews of student progress: 

- Annual reviews of the progress of all students were conducted in two 
LPAs ♦ 

- Annual reviews were scheduled on the basis of birthdates rather 
than end-of-year for many students. 

- Weekly progress of students was charted in resource specialist 
programs and special classes more than in designated instruction 
and services. 

- The lEP team process worked well and on time for annual reviews. 

- Resource specialists of one large LPA reported that about /.U per- 
cent of their students remained in t:he program for more than one 
year and would, therefore, require health and psycholo;;! ct 1 screen- 
ing. In. their opinion, the existing frequent contact with school 
psychologists and nurse would facilitate the needed in-depth 
assessment . 

* 

Updates of lEPs were made by revising objectives, Hevel\ ing 
new objectives, changing the time lino for accomplish- .it, Jhnnginp 
the students' placement, or using the results of a n ^ss(^ss'mMu' of 
the student's needs and abilities. 



Statewide Conclusions and/or Tren ds Over the 
Period 1976-77 through 1980-81 

o School staff and parents are wsin^» the individualized odutMt i on 
program process to communicate and pl;in toeothor for rhi' h^Mirt it 
of the student as well as to carry out the ^hie process protiu t ions, 

o Examining compliance with lop.al requirLMnenls is a rt^spons ihi li ty 
placed on the chief administrator in mult iplo-di strict spocini 
education LPAs. \ 

o Community advisory committees play a vital role in devolopin^ 
carrying out evaluation studies which involve parents. 

o LPAs are able to koep track of their handicapped students and nu^ 
their own existing program inf orinat ioiu 
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CHAPTER III—WERE HANDICAPPED STUDENTS TAUGHT IN 
THEIR LEAST RESTRICTIVE ENVIRONMENT? 



The Department's third evaluation question for 1980-81 was, "Were 
handicapped students taught in their least restrictive environment?" 

() InrlividiKil d<»cision.s were mride by parents dnd school staff nbout 
thp specicil and regular instructional settings for each student* 

o Both handicapped and nonhandicapped students benefited from 
their interaction in regular program activities* 

o Opportunities in regular school programs were available for, 

and used by, handicapped students enrolled in special day classes 
and in special centers* 

o The in-service training needs of regular classroom teachers for 

teaching their handicapped students were addressed, and the needs of 
special education staff were also addressed* 

Chapter III contains background information on the evaluation of least 
restrictive environment; the results of the Department's analysis and 
interpretation of local evaluation studies conducted in 1980-81 by 12 
established special education LPAs ; and statewide conclusions and trends 
from 1976-77 through 1980-81* 



Two of the major features of the California Master Plan for Special 
Education are the emphasis on the needs and abilities of each individual 
•itn«l(»nt and th(* provision of special education services on the basis of 
tht* most appropriate instructional setting or settinp,s, as stated in oach 
stud(*nt*s lEP, not on handicapping co..dition* The instructional settinj»s 
.ivailablp include the regular classroom, the resource specialist program, 
sp(*cial class, special center, the student's home or hospital, nonpublic 
school, and the six state special residential schools operated by the 
Department. It /.hould be noted that a given student mav participate in 
one or more setting during the same school day and that most students 
participate in regular class for at least part of their school day* 

The least restrictive environment (LRE) is a concept which is kept 
in mind by the child's parents and school staff as an lEP is developed, 
and as the results of the child's participation in particular instructional 
settings are noticed* The decision about the extent of participation in 
re^;ular class is made individually for each student and is documented in 
oach student's lEP. 

At the annual review of student progress, the appropriateness of the 
various instructional settings is again discussed. l-Aienever a student is 
changing schools, particularly in going from an elementary school to a 
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junior hipli or from junior high to senior high, the decision on regular 
tlass participation also includes the selection of appropriate regular class 
subjects and the selection of appropriate regular class teachers,'^ 

From the beginning of the implementation of the California Master Plan 
for Special Education, the Department has worked cooperatively with tho 
established special education LPAs to examine the concept of le-ist 
restrictive environment in practice. 



Findings on Least Restrictive Environment in 1980-81 

The LPAs* local evaluation studies provided information about individ- 
ual decisions, the benefits to handicapped and nonhandicapped students, 
opportunities for handicapped students in special classes and special 
centers, and the needs of regular and special education staff, Th ^ LPAs 
gathered this information by reviewing stuoent records; surveying and 
interviewing school staff, parents, and students; visiting school sites; 
observing classrooms and lEP meetings; and reviewin>> studies dom* in pre- 
vious years. (See Appendix D for a discussion of the methods used by the 
LPAs in 1980-81). Findings for each aspect of least restrictive environment 
will be summarized separately. Findings are for individual LPAs, unless 
otherwise stated. 

Individual decisions . Studies from three LPAs contained informa- 
tion on the decisions on the most appropriate instructional setting: 

Parents actively participated in most of the lEP team meetings. 

— Interpreters were available in two LPAs for non-English-speaking 
parents . 

— In the child study and lEP development process, the r-*^ ource 
specialists in two LPAs were the key personnel. 

Benefits to handicapped and nonhandicapped students . Stud ios from 
th ree LPAs contained information on the benefits of part ici pat io»i in 
particular settings: 

— Although nearly all handicapped students in three LPAs made 
social progress in their regular classes, some students experienced 
difficulties in keeping up with the work load. 

— Handicapped students in three LPAs were more confident, had more 
friends than in the past, brought assij>nmenls home, and looked for 
jobs for the first time. 

— Kc;',ular students In two l.PAs indicated knowlodi>o of the purpose ol 
special education programs. 

— Regular educat ion students in the seventh grade part ici pated in 
awareness assemblies on "Being Handicapped," presented by LPA 
program specialists. 




— (Note also the findings in Chapter IV, changes in student per- 
formance, and in Chapter V, attitudes toward special education 
serv ice^ • ) 

Opportunities in regular school programs for handicapped students 
enn^ 1 1 od in spec i nl day classes and spec ial centers . Studies from nine 
LPAs contained information about regular program participation: 

— Special day class students in six LPAs participated in regular 
classes, as had been specified in their lEPs. 

— Special center students (severely emotionally disturbed) attended 
regular or continuation high schools as they made progress. 

— Almost half of the high school students in special day classes 
were enrolled in regular vocational education programs and 
classes on and off their high school campuses. 

— Integration was seen as the special education teacher's responsi- 
bility at the elementary school level. 

— Recognizing the need for expanded career and vocational education 
opportunities for seventh and eighth grade hand i.c,apped students, 
one LPA formed a six-person task force, including'% parent 
representative, to recommend specific actions to be taken for the 
1981-82 school year. 

Needs of regular teachers and special education staff s Studies from 
eight LPAs contained information about staff efforts and resources needed 
to teach handicapped students in their own classrooms: 

— Regular classroom teachers varied in their knowledge of special 
education programs and procedures in one LPA and in their active 
participation in discussions at lEP team meetings in two other LPAs. 

— High school vocational education teachers in two LPAs were vicceot inp 
special education students. 

— Spec ial education teachers in two LPAs provided informal staff 
development at their own schools, 

— There was some confusion about the roles of regular education and 
special education administrators oa regular school campuses* 

— Regular education teacher participation in lEP development and 
lEP team meetings had increased over the past three years. 

— Regular teachers in one LPA had the materials they needed to carry 
out their part of students* lEPs, but they needed help in handling 
students with behavior problems in another LPA. 

— In-service workshops were conducted by five LPAs for regular and 
special teachers on topics determined by the results of surveys 
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conducted during the last months of the previous school year. For 
example, in one large LPA alone, over 400 regular teachers partici- 
pated m woDkshops on topics such as overview of special education 
legislation, parent and child rights, instructing handicapped 
students in regular classrooms, enhancing positive attitudes toward 
handicapped children and adults, and improving their own speaking 
and listening skills in Spanish. 

~ Teachers, principals, and parents rated the workshops they alt^uided 
as exceptionally good, in both content and materials, and they 
wanted more time in such workshops, which were attended by over 
3,500 persons. 

A Department-sponsored study found great efforts and ^^rcat needs 
for staff development, particularly for coordinating; existing', 
resources and for follow-up in schools and classrooms. 

Statewide Conclusions and/or Trends From 1967-77 Through 1980-81 

o School staff and parents are considering the needs of tho child 
m determining the most appropriate instructional settin.t;. 

o Regular teachers are seen as more accepting of special education 
s tudent s . 

o Staff development activities are aimed at the everyday u.se of 

information and skills on the job with special and re^culcir odnc/ition 
students. 

0 Resource specialists and the school principal are tho key persons at 
the school sites. 



31 



ERIC 



26 

\ 



CHAPTER IV— DID STUDENTS CHANGE AS A RESULT OF 
RECEIVING SPECIAL EDUCATION SERVICES? 



Chapter IV answers another perennial evaluation question, "Did students 
change as a result of receivinj> special education services?" 

o Students made progress in seven aspects of growth and development: 
personal development, participation in regular class, school conduct 
and participation in school activities, peer group relations, study . 
habits and skills, academic achievement, and work habits and skiTls. 

o Student progress was measured by teacher judgments, weekly progress 
charting, analysis of class assignments, parent observations, $tudents* 
self-reports, academic achievement test scores, and ratings of attain- 
ment of objectives in lEPs^ \ 

\ _ _ 

o Annual reviews of student progress indicated that the progress war- 
ranted consideration of a change in instructional placement, such as 
going from special class to the resource specialist program. 

o Not all students accomplished all the objectives in their lEPs. For 
those students, the lEP was reexamined, along with possible reasons 
for the less-than-f ul 1 attainraent. 

Chapter IV contains background information on the evaluation of ^student 
performance; the results of the Department *s analysis and interpretation of 
local evaluation studies conducted in 1980-81 by ten established special 
education local plan areas (LPAs); and statewide conclusions and trends 
over the period 1976-77 through 1980-81. 



Evaluation of Student Performance 

Two of the major features of the California Master Plan for Special 
Education are the emphasis on the needs and abilities of each student and 
the attention given continually to the changes in various aspects of the 
student's growth and development. In developing the objectives of each 
student's first lEP, an lEP team must choose between over-expectation, with 
certain failure, and under-expec t at ion , with triviaTdnd meaningless suc- 
cess. In measuring the individual student's change — whether progress, 
status quo, or regression — the lEP team, particularly the teacher and 
parent, has the benefit of shared experiences and can strike a more appro- 
priate balance between ove -expectation and under-expectation. The absolute 
amount of progress or regression is not nearly so important as is the 
immediate intervention once an educationally important change in student 
performance is detected. In special education, daily observation by 
teachers and parents and frequent communication are the chief instruments 
tor measuring and reporting change in an individual student. A student's 
lEP is much like continuous miniature research project, with one person — 
the student — as the scope of the research. When it is appropriate, the 
student participates in the measurement and reporting. 
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From the beginning of the implementation of the California Master Plan 
for Special Education, the Department has worked with the special education 
LPAs to examine the concept and practice of measurement of the performance 
of groups of special education students. 



The LPAs* local evaluation studies provided information about student 
performance in seven aspects of growth and development. The LPAs gathered 
this information by reviewing student records, including lEPs ; surveying 
and interviewing parents, school staff, and students; analyzing scores 
on standardized tests and of ratings of attainment of objectives; examining 
studies of promotion to higher grade levels; and examining how srudents were 
meeting local graduation requirements. (See Appendix D for a discussion of 
the methods used by LPAs in 1980^81.) Findings for each aspect of student 
growth and development will be summarized separately. Findings are from 
individual LPA studies of student performance, unless otherwise stated. 
(See also Chapters III and V,) 

Personal development 

— Self-concept and 3elf-conf idence improved. 

— Sense of responsibility and self-control improved. 

— Behavior improved. 



Participation in regular clags 

— Returning students could handle regular classroom demands. 

— Careful placement on regular campuses and in continuation schools 
promoted success. 



School conduct and participation in school activities 

— School attendance improved for intermediate and high school 
students chiefly because of counseling through student-te^^chor 
contact . 



Peer group relations 

— Regular and special students reported having friends in each 
others * c lasses . 

— Social skills improved in two LPAs. 

— Students talked about problems rather than hitting or throwing. 



Findings on Student Performance in 1980-81 
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Study habits and skills 



Resource specinlist students learned best when they understood 
the assij^ntnenc <ind could work a step at a time, alone or in 
small groups, and discuss the work. 

Parents reported that their children improved their concentration 
and remembered things better than in the past. 



Academic skills and achievement 

— Parents and school staff in two LPAs noticed improvement. 

— A variety of tests and measures of achievament were beinj^ used, 
along with weekly proj^ress charting. 

— Most handicapped students passed the LPA's minimum competency test 
and graduated. Nearly all the students who failed to pass decided 
to s^'ay in school another year to learn more and try again. 

— According to teacher judgment, hearing-impaired students were 
accomplishing an average of 72 percent of all the objectives 

\ ' in their lEPs, with a range of 50 percent to 99 percent. 

— Learning handicapped students in elementary schools scored higher 
on easier items, such as identifying alphabet letters, than on 
harder items, such as reading complete words and answering questions 
in a paragraph. Similar results were found in mathematics and 
written composition in a grade one criterion-referenced test taken 
by all students in the district. 

— Learning handicapped students scored lower in both reading and 
math after a summer vacation from school. 

— Learning handicapped students in special classes made about half as 
much gain on reading, spelling, and math tests as do typical 
regular students . 

— Communicatively handicapped and physically handLc<ippod students, 
particularly in the primary grades, made more progress in reading, 
writing, and math than other handicapped students, according to 
ratings of attainment of their individual objectives by program 
specialists at the time of annual review of progress. 

— Over a period of three years in special education programs, more 
handicapped students were promoted from grade to grade in the 
elementary schools than in high schools. 
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Work habits and skills 



— The work-study coordinator was a key in successful student 
outs id e work experience . 



Statewide Conclusions and/or Trends Over 
Che Period 1976-77 through 1980-81 

o The performance of groups of students is being studied more than in Lho 
past. 

o The lEPs of individual students are being used as a source of pro>.'ram 
data as well as for recording the results of services to the individunl 
student . 

o Attention is being, given to district graduation standards. 

o The focus remains on the growth and development of the individun! 
student, 

o No single standardized measure of student performanco tits .-ill siudonls 
at all ages. The most common measure continues to bo djiiy observation 
by teachers and' parents. 
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CHAPTF'R V— UERE THE ATTITUDES OF PARENTS, STUDENTS, AND 
SCHOOL STAFF FAVORABLE TOWARD THE SPECIAL EDUCATION SERVICES PROVIDED? 



Chapter V answers one of the Department's major evaluation questions 
for 1980-81, "Were the attitudes of parents, students, and school staff 
favorable toward the special education services provided?" 

o The overall level of satisfaction with special education programs and 
services remained high. 

o Parents understood and appreciated the services their children were 
getting. 

o Teachers were more accepting of handicapped students than they had been 
in the past and they wanted more information about how to teach them. 

Chapter V contains background information on the evaluation of atti- 
tudes toward special education services; the results of the Department's 
analysis and interpretation of local evaluation studies conducted in 1980-81 
by eleven special education local plan areas (LPAs); and statewide conclu- 
sions and trends over the period 1976-77 through 1980-81. 



Evaluation of Attitudes Towar:^ 
Special Education Services 

One of the major features of the California Master Plan for Special 
Education is the emphasis on the needs and abilities of each individual 
student. Another feature is the participation of parents, students, school 
statf, and members of the community in planning and refining local special^ 
education programs to meet the needs of current and future students and to 
bo as satisfying as possible to all concerned. The work on the C^rlifornia 
Master Plan for Special Education began in 1970, with a series of public 
meetings throughout the state in which the participants were asked to "tell 
us what you think things ought to be like." 

This pattern of concern for community satisfaction has been shown 
throughout the implementat ion., of the Master Plan. In any special education 
LPA, the local plan for providing special education si»i'vices is developed 
and rofined in cooperation with community leaders' and agency stafi. In 
addition, the plan must be acceptable to the local school board, or boards, 
in the case of multiple districts. A community advisory committee is 
designated to offer advice and be a channel for community suggestions and 
parent information. 

Findings on Attitudes in 1980-81 

The local evaluation studies provided information about attitudes 
expressed by six groups of persons: parents, regular and special teachers, 
program specialists, resource specialists, administrators, and students. 
The s\ ;cial education local plan areas (LPAs) gathered this information 
through interviewing individuals and groups and by distributing or mailing 
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surveys and questionnaires* (See Appendix D for a discussion of Che moLhods 
used by the LPA? m 1980-8 U) The findings for each of the six j^roups will 
be summariEed separately* 

An overview of the program aspects examined by the LPAs during 1980-?! 
is presented in Chart V-K The numbers of LPAs studying the atcicJdo^^ of 
Che six groups Coward e.-ich program area or service are identified i., Chi' 
chart* For example, four LPAs sCudied che actitudes of adminis tracers 
coward ''in-service training*'* It is important to note that each LPA 
designed ics own evaluation study to answer its own local evaluation ques- 
tions* The nature of the questions and the intended use of the results 
determined both the program aspects to be studied and the persons to bo 
questioned* 

Parents 



— Parents were satisfied with the lEP team process and t imo lines. 
(See che Introduction and Chapter It for discussions of che IKP, 
•'individualized educacion program," developed for each student.) 

- With special rand regular education prop.rams 

- With special transportation services, by parents of 
handicapped scudencs in special day classes 

- V/ich communicac ions between scliool and hone 

- With vocational education programs, and wanted more 

- With the progress cheir child was making 

- With the early identification of cheir child's nrohl(Mn 

- With the integration of their child in regular cla<; ^ 

- With facilities and equipmenc 

- Wich the attention given Co cheir rights and their children's 
rights 

- Wich che assessmenc and scudy of cheir child 

- Wich the carrying out of their child's lEP 

- With tne kinds of services provided 

- With opportunities for parent participation an<l involvement 

— Urban parents were deeply interested in their children's educa- 
tion and wanted Co parcicipaCe actively* The main harriers 
were their work and the consequent difficulty of adjustinp to 
school-time schedules* (The I.PA's rindim> was confirmed by thi.o 
comparable external studies) 



323 

ERIC 



MffliffilfflffTlliiU 



CHART V-1 

OVEPVIf-U OF PROGRAM ASPECTS EXAMINED IN LOCAL STl'F)IFS OF ATTITl'DES, 108A-«i 
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— Parents, wanted more information and more services, 

- Parent education workshops 

- Community advisory committee 

- Vocational education services 

— Parents were more knowledgeable about special education than 
in previous years* 



Teachers, regular and special 

— Regular teachers disliked paperwork and meetin^.s for developing 
lEPs but were pleased at the results. 

— Parents indicated that regular teachers were acceptive and 
support ive . 

— Special teachers were only mildly s^atisfied with the way referral 
procedures were working in some schools, but they were very pleased 
with the assistance given by their program specialists, particularly 
in chairing difficult lEP meetings, 

— Regular and special teachers appreciated each other's work, 
expressed general satisfaction with special education services, 
and were satisfied with the progress of their students and with 
due process procedures and in-service programs, 

— Special teachers were satisfied with transportation services 
for their students, 

- With the acceptance of their students by regular teachrrs 

- With the progress made by their students 

- With communication with parents 

- With due process procedures 

- With the implementation of their students* IKPs 

- With offerings of in-service training 

Program specialists 

— In their classroom visits and school reviews* program spt^cialists 
found many areas of program operation to commend. 

Resource specialists 

— Resource specialists reported smooth operation of special education 
programs at many schools, but they believed improvements wero nooded 
for secondary students in career and vocational education prop» ms, 

- Were satisfied with special education services in general 
and with transportation, home-sohool communicati n, and 
integration in regular classrooms. 




- Were satisfied with student progress and in-service training 
pro-ams, with due process procedures and the development of 
lEPs, assessment, and child study^ 

- Expressed need for improved facilities^ 
Administrators 

— School principals expressed general satisfaction with special 
education programs and pointed out specific examples of good 
teaching and cooperation with parents. 

— A special center principal pointed out the strong points of a 
centralized loca t ion. 

— Special education administrators expressed general satisfaction 
with special education programs and student programs, with 

due process procedures , with pa rent -school communication , 
parent education, assessment and child study, in-service training 
programs , and the management sys tem , wi th improvements needed in 
the management information system. 



Students 

— Regular and special high school students appreciated special 
education programs and often referred themselves for help. , 

— Student attitudes toward special education had continued to improve 
over the past three years. Labeling occurred less often, and the 
negative effects of labeling were seen as disappearing. 

— Special center high school students commented on their satisfaction 
at seeing their own improvr^ment . 

— Hearing impaired students on a high school campus appreciated 
their special instruction and the opportunities for attending 
regular classes; wanted improved support services, such as inter- 
preting, and a larger classroom; and wanted to stay at that campus. 

• — Students attending in-service training programs rated them as 
ef f ec t ivo . 

* 

-- Parents felt their children were satisfied with school "as a 
place to learn." 

Statewide Conclusions and/or Trends Over 
the Period 1976-77 through 1980-81 

Special education services and processes are better understood than in 
the past and are working well. 
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Regular education teachers are seen as accepting handicapped students. 

Program specialists are seen as excellent presenters of helpful special 
education inf orma t ion . 

There is widespread satisfaction with student progress. 
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CHAPTER VI—UERE SPECIAL EDUCATION LOCAL PLAN AREAS 
ASSISTED IN PREPARING TO EVALUATE 
THEIR OWN SPECIAL EDUCATION PROGRAMS? 



Because 1980-81 was the final year of preparation for statewide imple- 
mentation of Master Plan programs in 97 special education local plan areas, 
one of the Department's major evaluation questions was, "Were special 
education local plan areas (LPAs) assisted in preparing to evaluate their 
own special education programs?" There were four sub-questions regarding 
the capability of established, first-year implementers , and "planning" LPAs 
to conduct evaluation studies and to use this information to improve their 
own special education programs: 

1. Did LPAs evaluate their spe rial education programs? In 1980-81, 

^ 18 of the 21 established LPAs conducted oue or more evaluation studies 

of their special education programs. , 

2. Did LPAs indicate a need for technical assistance to evaluate their 
special education programs? A statewide needs assessment conducted in 
the fall of 1980 indicated that 60 LPAs wanted assistance in planning, 
conducting, and using the evaluation results to improve their own special 
education programs. 

3. Did the Department of Education provide the needed technical assis- 
tance? The Local Evaluation Assistance Unit of the Department's Office 
of Program Evaluation and Research (OPER) , in conjunction with the 
eight Evaluation Improvement Program Regional Centers, provided 
technical assistance to 80 LPAs that were either conducting or planning 
to conduct an evaluation study of their special education programs. 

^. f)id LPAs use evaluation information to improve their programs? 

As described in Chapter VII, the 18 LPAs that conducted evaluation 
studies during the 1980-81 school year used their evaluation findings 
to improve and change their pr'^<>rams in aspects such as staff develop- 
ment, measurement of student performance, and parent participation. 

Chapter VI contains background information on the Department's tech- 
nical assistance in program evc;luation for special education; activities in 
1980-81; and activities planned for 1981-82* 

, ' The Departtaent ' s Technical Ass is tance in 

Program Evaluation for Special Education 

It is the intent of the California Master Plan for Special Education 
to provide special education services for all children identified by lEP 
Le.ims as individuals with exceptional needs* It is further intended that 
these services address the educational needs of each student. Along with a 
phased statewide implementation of Master Plan services in special education 
local plan areas (LPAs) is a requirement for continual evaluation of the 
effectiveness of these special education programs by each LPA to ensure 
the highest quality educational offerings to the students served. 



ERIC 



37 

43 



From the be^i^ning of the implementation of the Cnlifornin Master Plan 
for Special Education, the Department*^ Office of Proi^ram KvaliMiioii ntul 
Research (OPER) has worked with established, first-year implemenLers, and 
planning LPAs to develop local capability to evaluate special education 

programs. As the established LPAs began to plan and con^iuct their own 

evaluation studies, and the Master Plan was authorized statewide, OPHiR 
shifted its emphasis from working only with established LPAs to creating a 
statewide local evaluation capability. During 1979-80, the Local Evaluation 
Assistance Unit of OPER developed a three-year statewide plan to provide 
technical assistance to all LPAs. The intent of the plan was to ensure that 
each LPA would be able to conduct at least one evaluation study during* 
1981-82, t-he first year of statewide implementation of the Master Plan. 
In this effort, OPER has worked with the Department's Office of Special 
Education and the eight Evaluation Improvement Program Regional Centers. (See 
Appendix B for the list of centers.) The aim of the technical assistance 
w.is to have local evaluation studies whose results could bo used locally to 
improve programs, to address current areas of concern, and to reflect the 
present status of special education programs at the state level. 

Technical Assistance Activities in Evaluation for I980-81 

Six major activities were conducted by the Local Evaluation Assistance 
Unit during 1980-81 : 

1. A statewide needs assessment to determine the needs for technical 
ass is tance 

2. Two-day workshops to upgrade evaluation skills and make LPAs aware 
of local evaluation requirements 

3. One-day "hands-on" workshops to assist LPAs in the development of 
their evaluation plans for 1981-82 

4. Preliminary review of local studies to ensure cost effectiveness 
and usability of the information derived from the studies 

5. Final : *view of local plan and study designs (to be completed by 
the Local Evaluation Assistance Unit of OPER) 

6. Ongoing assistance to established LPAs in conducting their 1980-81 
s tud i OS 

The activities were des i^^ned to focus on each LPA's program <oncerns or 
questions in relationship to the broad mandated statewide topics of state- 
wide* interest, .-is addressed in the Department's annual evaluation r(»port. 
(See Appendix ('.) The purpose of this (effort was to assi.st each LPA to 
plan< an evaluation study in one or more of these topics. The teehni<Ml 
plan als) addrovssed the unique demoj'.raph ic features nnd tht* specilic 
technical assistnnce ncM^ds of each l.PA in pKinninj* |o conrliiet il^ first 
eva I na t ion s tudy • 




In f.ill 1980, ihe Local EvdhidCion Assistanco Unit, in con juncc Ion wi th*- 
the eight Kvaluntiori Improvement Program Regional Centers, conducted a 
statewide needs assessment to determine if LPAs needed technical assistance. 
■T hi'q ^tirvt^y rtwo.-iled s Gve ra I areas _in which the 60 LPAs responding reported 
wanting some help. Chart Vl-1, "Statewide Needs Assessment for Special 
Education Evaluation Technical Assistance,'* presents the answers to nine 
questions and a list of the specific types of assistance needed. 



CHART VI- i 



STATEWIDE NEEDS ASSESSMENT FOR SPECIAL 
EDUCATION EVALUATION TECHNICAL ASSISTANCE 



Questions 



Number of Special Educat ton 
Local Plan Areas Responding-60 




1. !s the director well acquainted with 
lo(al, state and federal evaluation 
requirements (enumera t ive/spec ia 1 s tudies )? 

2. Has the local agency assigned evaluation 
responsibilities for special educat ion to 
any staff person? 

3. Is the assigned person trained in program 
evaluation? 

4. Does the assigned person understand the 
special education program and its 
evaluation requirements? 

Is there support staff availab^<=^ to assist 
the evaluator? 

6. Is there a budget to conduct evaluation 
activities? 

7. If rep,ional evaluation workshops and 
follow-up activities were offered, would 
you part i cipate? 

8. Are any special studies being conducted 
this year? 

'i 

9. What specific assistance would you 
need to evaluate your prograirs? 



LIST (comments by local staff): 
Awareness of guidelines 



2. Selection of development of evaluation instruments 

3. Utilization of data collected to apply to programs 

4. Awareness of what is needed for evaluation 

5. Knowledge of types of data to be collected 
&• Program evaluation designs 

7. Guidelines for conducting special studies 

8. WorksboDs to develop test item alternatives 

9. Evaluation of nonhomogenous classes 

10. Evaluation of special education classes with multiple handicaps in 
special day classes 

11. fiiva liiat ion of exper i'aental olas^^es resulcing from waiver; i.o., 
permission to enroll students with different disabilities in one 
special day c lass. 

12. Eva luat ion-, of ma ins t reami ng effects 

13. How to design and conduct a special study 

14. Development of observation scales; i.e., criteria and procedures 

15. Development of evaluation items in the cognitive area 

16. Development of evaluation items in affective area 

17. Validation of items to their specific domains 

18. Breaking of major skill areas into more discrete or subskill areas 
and writing or selecting items to assess these skills 

In cooperat ion with the Department's Office of Special Education, 
the Guide for Evaluating Special Education Programs was revised and used to 
assist LPAs in developing their own local evaluation capabilities* Tho 
contents of the ?u ide and the accompanying materials were intended to: 

1. Increase awareness of local, state and federal evaluation requi rcMuent s. 

2. Provide a process to begin to develop a local program evaluation 
plan for the purposes of improving local programs. 

3. Utilize existing information for evaluation activities and avoid, 
whenever possible, additional data collection efforts. 

Provide methods and orocedures which could be used to develop and 
carry out a local evaluation plan. This included: 
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- Selection of instruments 

- Methodology (designs, sampling) 

- Management information systems 

- Methods of data treatment 

- Data aggregation, display, analysis, and interpretation 

- Reporting information 

- Use of evaluation data at the local level for program improvement 

The Local Evaluation Assistance Unit and the eight Evaluation Improve- 
ment Program Regional Centers used these materials for both workshops and 
hands-on technical assistance with over 300 persons responsible for evaluat- 
ing local programs. The participants included school staff with a wide 
range of program and evaluation responsibilities. Department staff, and 
faculty from colleges and universities. In addition to the participants 
shown in Chart VI-2, more than 50 persons refined their own evaluation study 
designs in one-day "hands-on" workshops, which were held at the Evaluation 
Improvement Program Regional Center offices. In addition, staff of the 
Local Evaluation Assistance Unit of OPER provided technical assistance to 18 
LPAs that conducted one or more evaluation studies during the 1980-81* 

The Local Evaluation Assistance Unit developed and used a "Review 
Document for Local Special Education Evaluation Plan" in two ways. First, 
it was used in providing technical assistance, and later, in reviewing 98 
completed local evaluation plans containing 145 studies to be conducted 
during 1981-82. (See Appendices E and F.) 



Local Evaluation Assistance Activities for 1981-82 

Because of the need for technical assistance requested on the part 
of local apencios, the Local Evaluation Assistance Unit was planning the 
following activities for 1981-82: 

1. Review and assist all 97 special edi^cation local plan areas (LPAs) to 
complete and implement their ^valuation plans (evaluation studies) for 
1981-82. ITiis Includes a final review and approval of local evaluation 
plans during October 198K 

2. Assist local agencies in the selection and/or development of appropri- 
ate data collection instruments and methods of ^lita analysis, interpre- 
tation, and reporting for their use during 1981-82. 

3. Continue the two-day workshops in conjunction with the eight Evaluation 
Improvement Program Regional Centers, emphasizing the use of evaluation 
information by local and state levels. 

A. Sponsor regional symposia to discuss the findings of the local studies 
and local use of this in form ation to answer que stions of local conce rn 
and to improve programs • 

5. Analyze and interpret local findings for the Department's 1981-8? 
annual evaluation report on the California Master Plan for Special 
Kdncat ion. 
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6^ Prepare a statewide plan to provide technical assistance to IPAv* 

for 1982-83, including review of local evaluation plans with studies 
be conducted during 1982-83. 



CHART VI-2 



SUMMARY OF PERSONNKL WHO ATTENDED OPER/EIP WORKSHOPS FOK 
SPECIAL EDUCATION PROGRAM EVALUATION, 
DECEMBER, 1980, THROUGH MARCH, 1981 





Number who .attended, by workshop sites 


PERSONNEL 


Los 
Angeles 


oan 
Diego 


Da n 
Mateo 


Fresno 


Orange 


Sonoma 


Shas ta 




TOTAL 


Program 
Coordi n*i tor 


12 
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10 
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10 
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Director of 
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1 2 
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4 


5 
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Program 
Spec lal i St 
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2 


2 




1 




Ass istant 
Supe r in t enden t 








1 

1 
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Consul t ant 
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2 


2 












1 1 


Supe r Lilt endent 








A 






1 






Staff Develop- 
ment Coordi nator 


2 






I 




3 






6 


Teacher 


2 


2 


2 


3 




4 


3 


2 


18 


Resource 
Spec ia list 


2 


1 


3 


2 






4 


f) 


IS 


Col leges/ 
I'ni vers it ies 


2 












1 






TOTAL 
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KII* r<»h-rs to thr Lv<il nation Improvement Program Regional C(»nl(»rs, 

OSR rofors to iho DeparlmenC ' s Office of Special Education. 
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CHAPTER VII--WAS KVALUATION USKD TO IMPROVE SPFCIAL EDUCATION PROCKAiMS? 



Clidptpr VII answors the Dep«ir tmont *s fin.il evdluation question for 
1980-81, "Was evnluntion used to improve special educiition programs?" 

o Ev.ilnjtion w.ir» used hy t lu* special ediiention local plan nreas (LPAs) 
and by the Department to improve special education programs during 

1980- 81 and to prepare for further improvements during 1981-82 and 
future years • 

o Established special education LPAs made and proposed improvements 
in a wide variety of special education program aspects as a result 
of designing and conducting their own evaluation studies. 

o Improvements included (I) making the community and school more aware 
and involved in special education programs; (2) ensuring the rights 
of children and parents; (3) developing individualized education 
programs; (4) providing staff development for regular and special 
education teachers; (5) measuring student progress; (6) locating 
high school programs for hearing impaired students; (7) arranging 
special transportation schedules; (8) improving parent knowledge of 
special education programs and participation in their children's 
education; and (9) strengthening local program evaluation capability. 

o LPAs throughout California designed their local evaluation plans for 

1981- 82 to answer particular local evaluation questions and provide 
information for making local decisions for improving special 
education programs for handicapped students. 

o The Department (1) answered statewide evaluation questions; (2) 
determined statewide trends; (3) demonstrated progress toward the 
goal of a full educational opportunity for handicapped students; (A) 
began to set up a statewide source of information <qbout local 
eva luat ion s tud ies ; (5) ir'^ roved its technica 1 ass is t a nee and 
coordination functions in program evaluation for special educati<>n; 
and (6) designed its evaluation plan for special education progr^ims 
in 1981-82, the first year of statewide implementation of the ', 
California Master Plan for Special Education in 97 LPAs. i 

Chapter VII contains background information on program evaluation iu 
.special education, findings on the use of evaluation to improve programs 
during 1980-81, statewide conclusions or trends over the period 1976-77 
through 1980-81, and the Department's evaluation plan for 1981-82. 



Program Evaluation in Special Education 

I 

Two of the major features of the California Master Plan for Special 
Education are the emphasis on the individual child who may ne(ul special 
education services and the continual and comprehensive evaluation of 
special education programs to make suro that the needs of individual chil- 
dren are known and met. Continual evaluntion is the responsibility of the 
special education LPAs. Comprehensive evaluation is the responsibility of 
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the Department. Evaluation is intended to result in program improvement, 
not in complaining, criticism, or fault-finding. 

During the development and implementation of the California Master Plan 
for Special Education over the past eleven years in California, a series of 
progressive changes have occurred in the perception, policy, and practice 
of program evaluation in special education. The perceptions started as 
negative reactions to the idea bu|v have proQ;ressed to positive uses of 
evaluation information and of evaluation activities: 

- "It can't be done, because each child is different." 

- "We should have to evaluate a pro;>ram only when it is a pilot 
program. After we've proved its worth, we don't have to (>vjluatp 
anymore 

- "Program evaluation is something the Legislature wants, so wo mi^ht 
as well promise to cooperate and write an evaluation report. But it 
won't help us — it's not our r^^port. It's their report." 

- "The Department's evaluation report does have some worth to us. We 
know how many children were served last year in special education 
programs in the Master Plan regions, even if we have only average 
daily attendance (a.d.a.) fieuros for most other special (niucation 
programs in the rest of the state." 

- "Evaluation is something the Dopartment does to us i\t the local 
level, asking their questions and never answering our questions." 

- "Evaluation is not only the Department coming in to evaluate us, 
but also the independent evaluator, two federal ly-fundcnl contrac- 
tors, three graduate students, and a visiting foreign scli(>l-ir. Tliat 
takes staff energy and time, interrupts student instruct' >n time, 

and confuses parents. And we hardly ever get much usr il information 
back in time to do anything." 

- "Now we're supposed to evaluate our own programs, bat our special 
education staff doesn't . have much training in program evaluation 
and the evaluation staff doesn't know much about special educatiou." 

- "Evaluating our own programs gives us a chance to see how our 
programs ^are doing, and mannging our own (^valuation stuili(^s giv(»s us 
a chance to ask and answer our own evaluation questions." 

- "We can keep on doing what's workins: out well and put our atten- 
tion on what needs to be improved." 

Before the California Master Plan for Special Education, the policv 
of program evaluation in special education was implicit and limited. ^ was 
implicit in that there were no legal requirements lor (waluating r rail i t i.uial 
ongoing categorical programs as duthori/ed by state law and operated by 
districts or by )ffices of county suptMM nt (Mid^Mit s of schools. It was 
'imited in that the Department placed an evaluation requiriMiuMU on locally 
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operated projects cnrried on as specially funded extensions or supplements 
to locally operated programs. One example was the use of discretionary 
federal funds administered by the Department under Title VI, Part B, 
"Assistance to States" of the Education of the Handicapped Act, Public Law 
91-230, to fund competitive locally submitted project applications. Another 
example was tlie legislative provision for experimental proj>rams in special 
education, which essentially permitted tlie Oepartnifnt to waive certain 
provisions of the Education Code for a limited number of local special - 
education programs. 

Program evaluation before the California Master Plan for Special 
Education was nearly nonexistent; and the evaluation that did exist was 
informal and intermittent. Although over 600 of the local districts oper— 
ated at least one special education program, not one district had a local 
evaluation plan for evaluating and improving its special education program. 
In those relatively few districts with competitively awarded specially 
funded projects, evaluation was carried out for those projects alone, 
and it emphasized the documentation of project-funded activities more than 
the evaluation of the results. In addition, the Department did not evaluate 
programs on a statewide basis. 

With the adoption of the Master Plan by the State Board of Education, 
the policy changed to explicit and universal. All special education LPAs 
were held responsible for evaluating their programs in terms of the ^^rowth 
and development of their children. The legislation has progressively 
emphasized the intent for the use of evaluation for program improvement • 

llie practices have been changing throughout California as new special 
e<iacation LPAs have been established and have begun implementing the Cali- 
fornia Master Plan for Special Education. During the early years, the 
Department evaluated local programs in response to specific legislative 
requirements. Over the years, the Department's Office of Program Evaluation 
and Research (OPER) has worked with each established, first-year i»r.plement er, 
and "planning" LPA to assist it in evaluating its own special education 
programs. (See Chapter VI for a »I "^^cr ip t ion of Department activities in 
1980-81.) The statewide emphasis lias shifted from standard Department data 
collection for annual reporting to locally targeted studies whose results 
can be used twice: once for more immedinte use in improving programs, and 
a^jain, through le-analysis by the Department, to answM statewide evaluation 
quest ions . 



Findings on the Use of Evaluation to Improve Programs in 1980-81 

Til is section is divided into two parts, local uses and statewide uses. 

Local Uses. Special education LPAs used the information from their own 
evaluation studies to answer their own local evaluation questions and to 
improve local special education services and processes in the program 
aspects they studied, such as staff development, parent participation in the 
decisions about their children, facilities^ or transportation. Attention 
was focused on program areas of current interest and concern to local 
staff, parents, and community advisory committees. 
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In select inj; the program evaluation questions for inquiry, (»nch I. PA 
determined Its own projrratn aspect or aspects of Rre<itest local intorest and 
concern* Local selection of a particular aspect meant tliat thore was a 
local reason to conduct the study, and local intention to uso the informa- 
tion. For example, one LPA selected implementation of IF.Ps <iiuJ measuroment 
of student performance. Another LPA chose communication about stiidt^nts at 
the critical points of change between el^*mentary and secondary school 
s ites « 

In designii.g the evaluation studies, LPAs selected schools, pro^'ram.s , 
geoj>raphical areas, and types and ages of students according to local needs 
for evaluation information. For example, one LPA *^elected a high school 
in which a program for hearing-impaired students was Located. LPAs us(>(l 
existing iiifornia r ion or trained local staff in collecting new in! o rma t ion , 
particularly as part of their daily tasks. For example, progr am s pec i a 1 i sts 
in one LPA examined student pertormance as purl of the annual review of 
individual student progress. 

LPAs broadened the range of k^nds of person^ who work with ihe schools, 
including community advisory committees, school site councils :m\ graduate 
students in colleges and universities. For example, one LPA's community 
advisory committee developed a survey to send to parents. Another I. PA 
worked with professors and graduate students from a local uiiivorsity cind 
with parent facilitators. 

LPAs analyzed, discussed, and interpreted their own information 
and examined the results of other studios, includini» their own studic^s in 
previous years. For example, one LFV. has followed the prog,ress of <1 
sample of special education students over a threo-year period. Anoth<»r 
LPA compared the results, over three years, of its reviews of sIikUmU 
records and the provision of instruction and sorvicep, as shown on students' 
IKPs. Another LPA compar(»d its ri>sulls on parent part ic ipa t ion w i i h two 
other externally conducted studies. 

LPAs began to go beyond the completion and filing of an lonunl report 
to a continual process of program inquiry and improvement, providing 
progress reports and interim findinps to local program man.i^^ers nnd atlminis- 
trators. For example, one LPA conducted and complot»»d ten evaluation 
studies, large and small, long and short. The LPA designed one-pa^e flyers 
to show teachers the results of tho studies to whicJi they had contribntud 
informs t ion . 

LI*As investigated tlieir own important tindings with specific (ollow-- 
up studies so that specific, rather than general, program improvomeuts could 
be made. For example, ont* LPA surveye<i a snniple o( parents of lund i rappinl 
childrt^n who vjorc receiving special ^Mjucation srrvict»s and f(»und ^»ent»ral 
s,'it IS fart ion , i'Xt('[)t {(M' tho /irf.i ol spi i i 1 1 I i ans por I at ion , wh»'n» parents 
nl ^hiMtou m ';ptMial cl.i^si»*; r:<ptt's>rd soj*n d i i % a t i s fact i on . \\\c \.VA 

to 1 lowed up Its finding by suTveymg i-^v !• u i»i whose cn i I d w(mu to s^'hool 

on th'' special bust\s. T\\v results showed i^.r^Mt sat isf^icL ion w i Ih t ht» ' s 
service: drivors, courtesy, on-t imo , childrm IiI^cm! it, nn<l so lorth. Ono 
•xception, )iow«»vi*r, was tin* lenj»th of t imt* sonu' (»t tlio thilditMi r 
m the bus. The LPA and the bus company r«\Trt «in>»cd Hm" bii-. roiilfs .md 
schedules to shorten the time spont in ridiiu^. 
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f^nsed on informntion from a sample of its resource specialists, one 
LPA was able to estimate the number of person-days required for health and 
psychological screening for students remaining in the resource specialist 
program. 

Other program areas in which improvements were made or proposed in- 
cluded (I) allocation of staff; (2) location of programs for hearin^j;- 
impaired high school students; (3) in-service training of all kinds; (^») 
corrective actions lo change programs to match the spirit and intent of the 
Master Plan as well as the letter of the law and regulations; (5) reduction 
of paperwork burdens; (6) commendations to encourage continuance of worth- 
while program practices; (7) use of parent facilitators to talk with other 
parents; and (8) the use of locally developed informative brochures on Che 
educational opportunities for their children. 

Statewide us e:^. The Department used its knowledge of, and its experi- 
ence in evaluatirig, special education programs throughout the year. The 
Department had designed its evaluation plan to take advantage of the infor- 
mation which would be available from LPA evaluation studies-^in areas of 
statewide concern. At the same time, the Department provided technical 
assistance to LPAs in using existing information and, thereby, reducing 
duplication of evaluation efforts. 

The Department used evaluation to answer perennial evaluation ques- 
tions and to create a statewide picture of special education programs in 
1980-81. The Department noted statewide trends, both positive and negative 
in program operation as related to progress toward California's goal of full 
tMlucational opportunity for each child who may need special education 
st-rviros. Through its analysis of local evaluation sti!di|\s, the Di'pa r I r?u»nt 
was ablo to demonstrate efficiency and timeliness of local studies, to 
recORnize work of local evaluators, to commend local school boards and 
directors of special education programs, to provide a source of information 
about local and state evaluation efforts, and to give feedback to contribut- 
ing LPAs and Evaluation Improvement Program Regional Centers. 

In addition to answering perennial evaluation questions, the Depart- 
ment used evaluation information from current and previous years in prepar- 
ing* its responses to questions (and allegations) about special education 
programs . 

Going beyond the letter of the law, past fulfilling the reporting 
requirements, and addressing the intent for comprehensive evaluation, the 
Department has suggested areas in which program improvements are needed or 
in which policy or legislative chanp,e*? may be needed at state or federal 
Ip ve Is • 



Statewide Conclusions and/or Trends hrom lV/6-77 Through 1980-81 

The willingness and capability of special education LPAs to conduct 
their own evaluation studies have increased remarkably. 

Local evaluation information is used locally to improve programs. 
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The Department of Education is able to use local evaluation information 
in its statewide program evaluation. 



Department Evaluation Plan for 1981- 82 

In designing its statewide evaluation plan for 1981-82, the Department 
has examined the 97 local evaluation plans for 1981-82 and intends to 
continue its technical assistance efforts to help ensure that the local 
evaluation studies will yield timely, accurate, believable, and useful 
results at both local and state levels of special education programs. In 
addition, regional seminars will be organized so that LPAs can share their 
finding** and their use of evaluation information to improve their programs. 

The Department's statewide evaluation plan for 1981-82 is cooperative, 
coordinated, and efficient. 

■?* 

- Statewide . All 97 special education local plan areas are partici- 
pating, with U5 local evaluation studies planned and being 
conducted. (See Appendix F.) 

- Coopcrat ive . Local plan areas and the Department are working to- 
gether to obtain useful information for program improvement. 

- Coordinated . The Department provides technical assistance to local 
agency staff and reviews proposed local evaluation plans and 
studies. 

- Efficient . Local studies focus on topics of immediate local con- 
cern. The results are used at least twice: locally, to improve 
programs; and statewide, to share results and to help crt?ate a 
statewide picture of special education programs. 
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APPENDIX A 



LIST OF ElChTKEN KSTABLISHED SPECIAL EDUCATION LOCAL PLAN AREAS CONDUCTING 
EVALUATION STUDIES OF THEIR SPECIAL EDUCATION PROGRAMS ACCORDING 
TO THEIR OWN EVALUATION PLANS DURING 1980-81 



Contra Costa County 

Frosno Unified School District 

Glenn County 

Humboldt County and Del Norte County 
Los Angeles Unified School District 
Merced County 

Ornnge Unified School District 
Riverside County 

Sacramento City Unified School District 
S.in Diego City Unified School District 
San Juan Unified School' District 
Saqta Barbara County 
Santa Clara Counfy, Zone II 

Santa Clara County, Zones I, III, IV, V, and VI 
Stan is laus County 

West Orange County Consortium for Special Education 

West End San Bernardino County Consortium for Special Education 

Wliittier Area Cooperative for Special Education 

Findings from evaluation studies from these Special Education Local Plan 
Areas hav^** been analyzed, interpreted, and summarized for this Annual 
Evaluation Report, 



APPENDIX B 

LIST OF BIGHT EVALUATION IMPROVEMENT PROGRAM REGIONAL CENTERS 
PkuVFOINC TECHNICAL ASSISTANCE IN PROGRAM EVALUATION FOR SPECIAL EDUCATION 



Fresno County 
Los Angeles County 
Orange County 
Sacramento County 
San Diego County 
San Mateo County 
Shas ta County 
Sonoma County 
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APPENDIX C 



CALIFORNIA LEGISLATION RFOUIRiNC THI^ RrPORT 



com- 



*>660(). It IS Che intent of the Legislature to provide for onpoinr ..... 
prehensive evaluation of special educat^ion pro^>ram,s authorizod by this port. 
The Legislature finds and declares that the evaluation of these programs shall 
be designed to provide the Legislature, the Stale Board of Education, the De- 
partment of Education, and program adininis tra tors at county, district, and 
school levels with the information necessary to refine and improve po'licie,-, 
regulations, guidelines, and procedures on n continuing basis, and to assess 
the overall merits of these efforts* 

56602* In accordance with a program evaluation plan adopted pursuant to 
subdivision (e) of Section 56100, the superintendent shall submit to the board, 
the LPi;islature, and the Governor, an annual evaluation of the special education 
pro^rain-^ implemented under this part, 'fins evaluation shall: 

(a) Utilize existing information sources including fiscal records, child 
counts, other descriptive data, and program reviews to gather ongoinu infonna- 

"^tion regarding implementation of programs authorized by this chapter* 

(b) Utilize existing information ->to the inaxiinum extent feasible to conduct 
special evaluation studies of issues of stalewioe concern. Such studies may 
include, but need not be limited to> all of the following: (1) Pupil perfor- 
mance; (2) Placement of pupils in least restrictive environments; (3) D(^i>ree 
to which services identitied in indi vidu<3 1 izod education programs are provided; 
(A) Parent, pupil, teacher, program .<;pec inli s t , rt-source specialist, and 
administrator attitudes toward services and processes provided; (S) Program 
costs, including, but not limited to: (A) Expenditures for instructional 
personnel services, support service's, special transportation services, and 
regionalized services; (B) Capital outlay costs at the district and *,hoo] 
levels, and for special education services r»'gions, county offices, late 
special schools, and nonpublic, nonsectar i an schoo Is ; (C) Fundi'n^. -om. at 
the district, special education services region, county office, sut(^ special 
school, and nonpublic, nonsectarian school levels; (l ) Snmmarizt^ and rt^port on 
the results of special studie<^ regarding th^' >laster Plan for Special Kdncat ion 
performed pursuant to Section 33^*06. 

(d) Identify tlie numbers of inlividunls with exciptional needs, their 
racial and ethnic data, their c la.^^»s i I icat ion by J(»s i mat (^i instructional ser- 
vices , resource specialist, special day class or center, and nonpublic, n.on- 
sectarian schools, in aecordr-mco with criteria established by th(^ board and 
consistent with federal reporting recju i rement s • 

')f)60]. The Dep irtnient of F:durati^>n sh,il I , as oart ol the anmial evalna*- 
tion, report the i n f ormat i on n(,*cessarv fo ntine and im[)rovi^ statt^widc policies, 
regulations, en id(» I i nes , and proceduri\s eev<»loDed pursuant lo this part* 

•^^hi'si' lidiicatii)n Code provisions w(m jai n*J f ■ Cliapti-r /9/ and rbapli»r M)\ 
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APPENDIX D 



METHODS USED BY SPECIAL EDUCATION LOCAL PLAN 
AREAS (LPAs) IN 1980-81 IN THEIR EVALUATION STUDIES 



The .spoci.il o4uc.it i n locnl plan nrons (LPAs) dosivnod their ov^iluntion 
stu^ln's to use existiriR d;ita and capi t .il i ze on pro}\rrm opt^rations, such as 
annual reviews of student progress, wherever possible, 

'Hie evaluation specialists in the LPAs developed their desi5>ns, including 
tluMr 'lar*! collection methods and instruments, and tips on conduct inp, evaluation 
studies in a cost-effective and positive way, with technical assistance from the 
staff of the Local Evaluation Assistance Unit of th Department's Office of Pro- 
yvAm Evaluation and Research. These staff were responsible for reviewing the 
local evaluation plans and proposed evaluation studies as well as for providing 
technical assistance. The technical assistance was aimed at designing feasible, 
workable, approvable usable studies, not at directing the selection of the 
topics or local evaluation questions/ 

!he LPA I'V.'i 1 uai ors ' primary .iim was to answer local valuation qiu^stions 
by producing information which would be accurate, meaninj^ful, and usable lo- 
cally. A secondary aim was to produce information which the Department could 
collect, interpret, and use for statewide evaluation of special education 
programs; for example, ir. this annual evaluation report. 

The LPAs used a great variety of data collection methods and instruments, 
which were selected, adapted, or created to fit the LPA, the local evaluation 
qui'Slion, and the persons who would provide or collect the data. In collecting 
the data for their local education studies during 1980-81, the 18 LPAs: 

o Hxamined 1,101 students' records; A, 396 individualized education 
programs (lEPs); and test scores for 4,107 students, 

o Visited 246 school sites and 328 homes of parents of special education 
students , 

o Observed 87 classrooms and 36 lEP team meetings. 

o Surveyed 2,/3l school staff members, 1, 061 parent?, .jui 47 students, 

0 Interviewed 168 school staff members, 1,523 parents, and 149 students, 

o Examined program records representing 52,532 students and staff, 

o Kxamined reactions to in-service workshops of 1,134 persons, including 
parentis , school staff, students, and commun i ty persons • 

Training of data collectors was particularly important before the data 
were collected, whether the task was making visit?; to schools; interviewing 
p.irents, teachers, and students ( inc ludi ng work i nr with interpreters for 

ir in>»-inipai red , or tor speakers of languages oth(>r ihm F.ni;lish when the data 
solicitor (lid not speak that language); reviewing student records; administer- 
in:» s t<^nd.i rd ized tests; observing classrooms; or playini> a par t ic i pant -obs erve r 
ro l»» I n IKP meet i ngs • 



'ITio local study designs called for the participation of students, parents, 
teachers, and administrators on school sites and in communities. Hi is partic- 
ipation took several forms: selecting evaluation questions, collecting data, 
providing data, interpreting the results, using the results to improve programs, 
ana planning follow-up studies. 

The LPAs collected their data for their evaluation studies in three broad 
ways: examination of existing information, collection of new information, and 
comparison of the results of their local evaluation studies with the results of 
other studies where appropriate. Table M (for Methods) displays the methods 
us^d and the number of LPAs using each method during 1980-81. 



TABLE M 

METHODS USED BY SPECIAL EDUCATION LOCAL PLAN AREAS (LPAs) 
IN THEIR LOCAL EVALUATION STUDIES DURING 1980-81 

Number of LPAs 



Method usinr, method 

I. Examina*-ion of existing prograin and student records 16 

- Tabulations from program files (by hand or 
computer -gene rated ) 

- Referrals 1 

- Notices and responses from parents b 
lEP team meet ings 1 
lEP informati on 

- Services to be provided to students/teachers 8 

- Objectives co be achieved by students 

- At school 8 

- At home I 

- Progress toward meeting objectives 8 

- Lenji^th of time receiving service 2 

- Proficiency standards I 

- Grade-level changes: promotion, retention, graduation \ 

- Secondary students 

- Ca re»M" /vocat iona I oducition 1 

- Gra^liMtion standards i 



TtMcht^r case - load 1 i s ts of ^iLii Jont s bo i lu* t aui»h L 
(n^roilmenf and staffing data) 



Method 



Number of LPAs 
usinR method 



?. Kxcimindtion of new 1 y-Rathered progrnm and student data 16 

- Katin^»s of attainmont of individual student objectives 

at Lime of annual review of student progress 2 

Participant-observer techniques in group meet ings 3 

" School site visits 10 

- Classroom ob,^ervation 5 

- lEP team observation 2 
Interviews, alone or in groups, in person or on telephone, 

with and 'without interpreters 9 

- Handout and mailout written surveys or questionnaires 13 

- Administration of regionwide standardized achievement tests 2 

- Teacher analysis of class assignments 4 

- Observation of student performance over a period of time 11 

- Teacher-made tests and quizzes H 

- Curriculum-related tests 11 

- Weekly checklists of progress 1 

3. Comparison ^ith data from other studies 8 

- Locally conducted (includes theses for Master's Degree, 

early retiree projects, previous studies) 6 

- rixternally conducted of local programs 3 

- Conducted in other programs and reported in the literature 1 



Through such statewide groups as the California Special Education Eval- 
uators, at program evaluation workshops sponsored by the Department and the 
Evaluation Improvement Program Regional Centers, and through ordinary, con- 
tinual professional interchange, the evaluators shared their experiences, their 
methods, and the program improvments recu— tended or put into place as a result 
of their evaluation studies. 
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APPENDIX E 



Office of Program Evaluation and Research (OPER) Review Document 
for Local Special Education Evciluation Plan 
1981-82 



a. Is there a plan for a special study in 
one or more of the following areas: 



Pupi I performance? 

Placement of pupils in least 
ros t r i C: I ve environments? 

Dev^.ree to which services identified 
in lEPs are provided? 

Parent, pupil, administrator, 
teacher, program specialist, and 
resources specialist attitudes toward 
services and processes provided? 

Cos t ef fee tivene ss? 



Ifi th^» stuHly bavsed on a local evaluation 
quest ion? 

c. Is the local evaluation questio; ia- 

V lu«lo(i in tho description of the study? 



c-? the dcsc rip t ion specify who is 
••'•sponsible for conducting the study? 



U Special Study 



Yes/ 
No 



Comment s 
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K Special Study (continued) 



Yes/ 
No 



Comments 



e» Does the description of the study 
include : 

- Method (pretest, post-test, time 
series, etcO? 

Instrumen ^ (achievement tests, 
surveys, interviews, records, MIS 
forms, etc.)? 

- Plan for collecting information 
(who, how, when, etc.)? 

- Data analysis? 

Possible uses of the information? 

- Reporting of information? 



a. Are the following data element^ included 
in the student recordkeeping system^: 

Pupils by handic'iD (by age)? 

Placement of pupils by instructional 
setting specified on lEP? 

- Movement of pupils between instruc- 
tional settings? 

- Ethnicity? 



2. Pupil Count 



Yes/ 
No 



Comments 
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'upi 1 O^unt (continued) 



b. Are local enumerative data elements 
listed to answer local questions? 

c. Is the method for collecting and reporting 
cIk* onumorative information described? 

d. Will tlie col lection method produce 
au unduplicated count for all pupils 
served in special education during on 
«innu.il reporting period including: 

- Handicapping condition (minimum of 
1 I coiuH t ions )? 

- KvHir instructional settings? 

- MovemtMit of pupils holwoon instruc- 
riv)nal settings and out of special 
Oiluc a t ion? 



i. Ma.^ ^.'tr.oiU Plan 



Is cher*^ a maa.iLU'nont pl<in for 
v>n hict m;; the LPA*s evaluation? 

l^^u*^ thi- iian.u^onient plan inoUicie: 

- Assii^nt^d local st*iff person r 

.»ut ^ [ ,^va I uar->rs 

* u'^'^ M* !a as^ i*iued? 



Yes/ 
No 



No 



Comments 



Comments 
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APPENDIX F 



LOCAL EVALUATION STUDIES FOR 1981-82 IN 
riVE TOPIC AREAS OF STATEWIDE INTEREST 



DunrKj !9;n-:;?, a Lotal ot \Ah lo(.il ov.ilu<ition studios will be 
(onductod by the 9/ Special Cducition Loc<il Plan Areas. Each study 
addrossos ono of the five topics of statewide interest, as contained 
in Lducation lode Section 56602(b): provision of special education 
services accordinq to i ndi v idual i ^'cd education programs ( lEPs) , place- 
ment in least restrictive environment, student performance, attitudes 
toward special education services, and program costs. The studies are 
listed below according to the five topics. Further information on the 
studies may be obtained from the Local Evaluation Assistance Unit in 
the Department's Office of Program Evaluation and Research. 



I . Local Evaluation Studies in "l>rovision of Special Education 
Services accordinq to Individualized Education Programs " 

Extent and quality of the lEPs being implemented. 

Are all eliqible pupils placed by the juvenile 
court system receiving all services, as outlined 
by Itie ICP? 

Do all pupils in resource sf)ecialist programs 
have lEPs on tile in schools of placement? 

Lt tocti veness ot criteria for placement of 
pupil', in designated instruction and services. 

What is the degree and quility or service 
()rovided, as identified on :he lEP? 

Manaqement information system study of class 
si/e and pupil admission/exit flow. 

latiloq of activities performed by resource 
specialist proqrani t-^cher. 

Does the management infc 'ation system 
provide timely, relevant, and accur<ite pupil 
inf onnit ion? 

wtiat are parents interested in knowing about 
speciil education? How to deal with your 
(hild's development at homo; legal rights 
\t\i\ your child; comnum ications betw(H>n homo 
and -rhool; <ivnreness and lEPs. 
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Relationship between the local vocational education 
curricula and competencies to competencies required 
hy community employers. 

With the revised governance model, is there any 
change in the program director's role and function? 

Has the child intervention team made a difference 
in pupil referral or olacements? 

What is the ratio of pupil referrals to placement 
as a result of the nev/ eligibility criteria for 
learning handicapped pupils? 

How well acquainted are the resource specialist 
program teachers and parents of all pupils with 
the lEPs? With the due process procedures? 

Have complaints and "fair hcMrinqs" increased or 
decreased? Why? 

What is the quility and relationship of first-stated 
different iatod ()t)jectives to specific (joals in 
pupi Is* I El's: 

Is there an o[)S(^rvablo difteronco in the quality 
of ohjoctivos written hv lullv crndt^nl i » loil 
tea(hcrs and those written bv prchminiry 
teachors or ljy staff with w livers? 

What are the ta( tors nM*tt(nl to tfie su((psstul 
integration of sev(}roly fiand ic .ippotl , f)hyM( illy 
handicapped, or coinmnn-ic ati vcly handicappinl 
students? In v/hat ( Lissos ^sut) u^cts , tor how 
long, and with v/hat results ir(* th(?se students 
integrated ? 

What servicos is the resource specialist provid- 
inq for student and le.idiers at the local scho -1 
si te' 

What improvements or reductions in service u'o 
noted by pirents of stu(]onts pl ued in spe( Ml 
education prior to lo* •! Mi[)1t'in(ntat ion o! th(^ 
( il i lornia Mast(»r ^'I m ' 

Whit iro th*^ iMontfily ( fi m.,.*-, in euro I I'Jien t ^ 
sn V M e 'vri)i»(»r (. !'>n',, uid in st.itlin^j r )l los ' 

Is Ifi r ' mv diltereri(,e ir. otivn-^'^^s l>tMw(nMi 

lev»*l ' WInt irei th»' '>ro qr n ih»tMl 
M}(u (Wr'in(»nt it tf)e set «>rul n y level.' 

How adegu ite was ttn* r>sv( ho-jnlu^ jf i»*n>l r>se>s- 
ment ot pupi Is ' 
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Does the inana-jement information system provide timely, 
relevant, .ind accurate information to assist the 
manarjemont of special education programs? 

How effective is the program management system in 
providinj special education servicus, md what 
changes should be made for improvement? 

What is the level, adec|uacy, and quality of in- 
servirp training? 

How elective has the special educator/parent 
TaLiliLalor program been? 

To what deqree are ICPs being implemented? 

[valuato the current criteria used to place pupils 
in the resource specialist progr^nj >ir»d special day 
c lasses . 

Examine the assessment, pi icement, and re-assessment 
of special education pupils. 

Does the scheduling of daily activities differ among 
resource speci al ist teachers? 

Degree to which services identified in the lEP are 
prov ided. 

Examine the time-use difference between the itinerant 
and single site resource specialist at the elementary 
lovoK 

Px imirK.* 'he need for special therapy services at 
all levels. Examine the effect of these services 
on pupils who have received these services. 

What eMvct do eligibility criteria hive upon 
idont I Meat ion and placement of students in 
spe^^ i 1 1 day c 1 asses? 

>lh it t\/[M^s of regular c lassroom modi I ication". /ere 
itteinpted and what impact can be demonstrated on 
children before placement in special education? 

Implemoritat ion of services and quality ot lE!^s. 

Is further inservice training needed in tfie aroi 
<)f IIV wri t in<]? 

mnno lEf^s in rel ati onsh i[) to odurationil ni^ed 
ind K.tuil cl issroom instruction. 

DetenihfUMvhether the services contnnod in the lEPs 
ir(» provided. 
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Wh.it is the c^u^li^.y and effectiveness of lEPs? 



Which children are referred to special education and 
v/hy? 

Identification of factors which promote for successful 
integration of severely handicapped pupils into the 
reqular school setting. 

Examine the cycle of services provided to special 
educat ion pup i Is . 

How did the increase in resource specialist program 
case load atlect the quality of pupil services, 
cor'mjn icat ion between parents-Drogram, and other 
r)ro(jr im personnel ? 

Degree to which services identiMed in th(^ IFI^ 
were prov ided. 

How do parents perceive special education services 
their child is receiving^ l!ow do they [>erceivo 
( nmnun i(,at ions between parent-pr^oiirani.'' 

Degree to which services in the If'' ar(? providinl. 

lo what dour(H^ are [)aront.s .iv/<tro ind^)r nilorfnod 
it)Out III o(\u( ition •>orvho<, b(MMg r(\(MV(Hl 
by thpir ( In Idri^n i' To what d^Mjree .jrr pir^'nts 
Siti^lied //ith sp<->? ill si?rvi<es hoiiu] roiiMvtvl 
by th(Mr chi Idren.'' 



1 1 . y^lLL^.^^lb^AUiVl A^il'lL^A Jil ,'?J:l^i^!".G.^ t Jn Least Restrict ivo 

What are the criteria tor placenient of pupils in 
bpeci i\ day class and resource specialist programs 
for the learning handicapped? -Xro th(}re common 
^ operational entrance cri teri i that teachers, 
idfMin I str.3 tors, parents, a(joncy reprosentat i vi^s, 
or IE'' teams are using throughout the county, and 
i \ so, what are they? 

Old th^? pert (Option teachor *il)ilily to t .irry out 
Mister M in functions chinae is a t^'sult ot m- 
s'^rv i( tr nn in J 

Did thc^ ibihty h> interi(t N*>l.v^*tui s'»0(i.i| irul 
rf'gul uupMs ( h.inge is a result ol seit-hel[» 
insfru<tion in r**'|al s« lion I utivitu^s' 
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Did the ability of regular and special teachers to 
improve pupil behavior change as a result of inservice 
training on assertive discipline? 

What are the outcomes of special education staff 
train in«j a 

efficiency of moving pupils out of special education 
<in(J b.uk into the regular pro*) ram. 

Examine the placement of pupils in the resource 
specialist program as compared to special day 
c lasses. 

Do elementary and secondary school districts 
have an advantage in mainstreaming special educa- 
tion pupils as compared to a unified school district? 

Management information system study of pupil into- 
(] rat ion by subject area. 

What areas of inservice do special education 
teachers need to facilitate services to special 
education pupils, parents and regular teachers? 

How effective are the placement procedures for 
enrolling special education pupils in the least 
restrictive environment, including referral and 
assessment? 

What is the status of pupil movement between set- 
tings, and what '^actors/and or common behaviors 
weigh heaviest in those movements? 

Does integration time increase proportionately as 
students are in programs longer, oecome oldor, or 
are in less restrictive pla^v lents? 

Howv/ell are the revised specific learning disabilities 
apDlied, and what effects are noted in enrollment/ 
placement compared with 1980-31? 

Is the elementary resource specialist program an 
effective model to increase pupil participation 
in the regular education program? What variables 
enhance or prevent this participation? 

What amount of time, type, and guality of activities 
J re learning handicapped pupils from special day 
classes roceivinq in the regular education program? 

Which pupils ire pi iced in the least restrictive 
environment and when changing progrMi'>, do they 
move to a more or less restrictive environment? 
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What is the difference in percent of special class 
pupils v/ho have moved to a less-restrictive environ- 
ment between 1980-81 and 1981-8?? 



Local Evaluation Studies in "Student Performa nc e" 

A comDarison of learning tasks of trainable 
mentally retarded pupils to regular pupils to 
determine if the tasks can be differenlial ly 
structured. 

How much growth was made by pupils in reading in 
the special classes for the severely language 
disordered? 

What level of skills in reading, math and composi- 
tion do elementary school learning handicapped 
pupils in resource specialist programs demonstrate 
Jt the end of 1931-?^2 school year? 

What percent of secondary school learning handi- 
capped pupils in resource specialist proqrams pass 
the local proficiency tests in reading, math and 
composition in the 1981-8? year? 

What is the math achievemont of learning handi- 
capped S()eci.n day class pupils whoso (CPs contain 
a math objective? 

What is tlie relationship uf ach i evcMm^nf in r^Mding 
ind 'Matli bv resource specialist f)ro'iraiM pur^ls to 
time spent in the regular program? 

•\re c iroer and voc itiunal <)i)al'> uul objatives 
contained in the lESs met.'' 

Are proficiency standards, either roqul ar or 
alternative, specified in the lEP for special 
education high school seniors, and are Iho goals 
in the lEP related to those standards? When 
there are alternative standards are they related 
to the maximum oupil expectancy and pupil porloniMnce? 

What is the movement of special education pupils 
within special education: is the d i roc tion back 
to the r'^gular progr^im? 

What vari'ibles is th(^ rc^sonrco ^^pptJalist ()ro(|r mi 
ire most important to/Mrd pupil k li u»viMO(.nt ' 

Khipvemonl is noted lor stud<»nts ph(.(N| in 
s|)(mJ,iI (|,iy cl iSSf^s in ig/w \(hl ./ho, in ''jll-.^!/: 

a. reinain in special day class, 

1). transfer to Iho resource si ei. iihsl pro()r»im, or 

C- return to regular school proMrm? 
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l^hdt differential standards are set by lEP teams for 
hiqh school special education students who are unable 
lo meet the district graduation standards? 

What are the factors correlated to pupil performance? 



What IS the cause of achievement decline of pupils 
when the/ niove to a higher level? 

What percent of special education pupils will meet 
what percent of their objectives in the lEP? 

What is the vjrowth of resource' special ist program 
pupils in tije areas of math, reading, and spelling? 

What is the success of pupils who were in special, 
day classes for aphasic children in 1980-81 and 
transferred to a less restrictive environment in 
1981-82? 

Academic success of pupils in resource specialist 
programs and in special day classes- 

Academic progress of resource specialist program 
pup i Is. 

Attainment of pupil objectives as specified on the 



There are no differences in academic growth in read- 
in() and in<)th between resource specialist program 
pupils and special day class pupils. 

Whit changes in student performance occur when the 
program is changed from a pull-out to a resource 
special ist model ? 

Is the special education program improving academic 
achievement and successful integration for special 
d'\y cl iss pupils with n average to high academic 
expect' ncy? 

AcKleinic achievement of all special education pupils. 

How well are the reading objectives written, rated 
as being met, and why are they being met or not? 

.Academic achievement in math and reading of pupils 
on all levels, by length of time in the resource 
spec i a] ist program. 

Did the ability of learning handu:<j()ped pupils 
to decode words improve? 
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What is the rate of attainment of the objectives con- 
tained in the lEP? 

NonbMSCd assessment for Hispanic pupils? 

The degree to which short term objectives are 
achieved . 

Readin^j and math retention as a result of sumrner 
school experience. 

How successful are pupils in attaining specific 
lEP objectives in math, readin<j, lanquaqe, career 
education, social adjustment, and psycho-perceptual? 

How long does a pupil remain in soecial education? 

How does lenqth of participation in speci il day 
class affect the reading and m<)th performance of 
learninq hindicapped oupils? 



Local r vj) I u^) I i on Stud ies i n " /\ 1 1 i t u do_s Tow a rd S[)e( ial Fducation 
"Serjnc_os" 

Awareness, involvement, and s<itisfactiori of 
pirents vnth special education. 

How special education .services are percoived? 

Are parents of special education pupils satisfied 
//ith the services their children are recoivinq? 

Eximine the attitudes of recjul ir classroom teachers 
toward special day class pupils integrated into 
their c 1 asses. 

LAaiii'iriC the perc^eutiuns tiriu knowledge cjf regular 
te^^chers who have special day class pupils in 
their c1 ^ssrooms . 

Attitudes tov;ards services provided. 

1)1(1 the 'itUtu(ie of resource six^ci al ists towards 
their role and their respons ihi ht i es towards tl)e 
assessoient and placement of oupils rhange as a 
resuJt of in-service trainin()/ 

Attitudes of reguUr and speci<)1 education 
teachers toward services provided learning handi- 
capped pupils in resource specialist programs, 
according to district si^e ind grade level.' 

Parent attitude toward servicers and orocosses 
provided. 
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Wh<U are attitudes of parents, regular teachers, 
.idrnini slralors , students and resource specialists 
towards services provided by the resource specialist 
program? 

Do the differences in scheduling of daily activities 
affect the attitudes toward resource specialist pro- 
grams it each school site? 

What changes in attitudes occur when the procirain 
is changed from j pull-out to a resource speci«ilist 
program? 

Parent satisfaction with resource speci(ilist and 
special day class, .services. 

Determine the changes in knowledge and attitudes 
of regular and special education staff towards 
the Master Plan after its first year of 
implementation. 

What are the opinions of parents of special educa- 
tion pupil5> regular education teachers, and other 
personnel involved in the ICP process toward special 
education services? 

Identification of the critical components of the 
resource specialist prog-ram and the assessment 
of attitudes toward these services. 

What are the attitudes of regular teachers toward 
ma instr^eami ng? 

Wh(it are teachers* attitudes toward rnainstreaniing 
<ifter a year of in-service training? 

Do principals and special education teachers see 
tfio new role of the program specialists as con- 
ducive in improving instruction in special educa- 
tion programs? 

What is the impact of Senate Bill 769 pro(}ran) 
changes on the quality of pronram services <ib per- 
ceived by resource specialist teachers and local 
directors and coordinators? 



What are the results of past and niost recent 
staff development activities as porceived by 
reso'jrce specialist teachers? 

Attitudes of parents, staff, and pupils toward 
sorvues ()rovN]ed. 
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Differences between attitudes of special education 
parents when communication is organized and when 
it isn't. 

Oo resource specialists perceive that they are 
receiving adequate infonnation from the child 
study and lEP teams? 

Are regular teachers perceiving they have an 
rictive role in the lEP process? 

Are connnun icat ion processes between educators 
md parents of handicapped pupils effective? 

To what extent is integration taking place, and 
what are the positive and negative features of 
integration? 

How Sitisfied are parents of students assigned 
to schools outside their neighborhood with the 
placement, programs, and services, including 
tr insoorta tion ? 

Are site administrators satisfied with student 
placements )nd the delivery of special education 
pro<|r(UMs and services? 

flow accurate is the infonnation entered in the 
rnanaoe:nent infonnation system? 

What are the effects on staff of the reduction 
in program specialist staff? 

What would be tho effects of eliniination of the 
resourcp sf)OC i ihst progran^ 

Determine the eff ecti veness of a county nlan tor 
chinqinq attitudes and understanding all of staffs 

What ire p arent perceptions of their role in the 
development of their child's lEP? 

Teachor attitudes towards services and processes 
providfHl, 

Attitudes or resource specialist teachers and 
parents to^vard the loast restrictive environment 
and ilternaio modes n\ service de I i very . 

Do regular teachers perceive that they receive 
adoguate infonnation from the If!" team in recjrjrd 
fo 'i» \ instro<ifnod oup i I s ? 

What ar{» tho ittitiidos ol spocial ind r(nnil,u* 
education tei^hors toward the resource m 1 r.t 
program? 
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V . Loca] Eval uation Studies in "Program Costs ' ' 



The efficiency, economy, effectiveness rznd safety 
of the special education transportation operation 
system, including costs. 

An antilysis of the present transportalion syslofn, 
including costs for.pupils to receive (.onlral- 
ized services. 

What are the actual program costs of running 
the special education programs? 

Review of program costs for 3-year period in 
relationship to per pupil costs for all programs, 
including transportation- 
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